-- Logs begin at Thu 2022-06-23 08:26:16 UTC, end at Thu 2022-06-23 09:44:21 UTC. -- Jun 23 09:15:14.917980 dv-cinder-847274-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 09:15:14.927133 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 09:15:14 2022] *** Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: nodename: dv-cinder-847274-1-iscsi Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: machine: x86_64 Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: clock source: unix Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: pcre jit disabled Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: detected number of CPU cores: 4 Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: current working directory: / Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: detected binary path: /usr/bin/uwsgi-core Jun 23 09:15:14.929126 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: your processes number limit is 47680 Jun 23 09:15:14.929925 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: your memory page size is 4096 bytes Jun 23 09:15:14.929925 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: detected max file descriptor number: 2048 Jun 23 09:15:14.929925 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: lock engine: pthread robust mutexes Jun 23 09:15:14.929925 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: thunder lock: enabled Jun 23 09:15:14.929925 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 09:15:14.929925 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 09:15:14.971905 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: Python main interpreter initialized at 0x5642add889c0 Jun 23 09:15:14.971905 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: python threads support enabled Jun 23 09:15:14.971905 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: your server socket listen backlog is limited to 100 connections Jun 23 09:15:14.971905 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: your mercy for graceful operations on workers is 90 seconds Jun 23 09:15:14.972716 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 09:15:14.972798 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: *** Operational MODE: preforking *** Jun 23 09:15:14.973038 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: *** uWSGI is running in multiple interpreter mode *** Jun 23 09:15:14.973038 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: spawned uWSGI master process (pid: 103984) Jun 23 09:15:14.973216 dv-cinder-847274-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 09:15:14.976670 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: spawned uWSGI worker 1 (pid: 103985, cores: 1) Jun 23 09:15:14.976670 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: spawned uWSGI worker 2 (pid: 103986, cores: 1) Jun 23 09:15:14.976670 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 09:15:15.631256 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 09:15:15.631870 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 09:15:16.762435 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:15:16.762435 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: from cryptography.utils import int_from_bytes Jun 23 09:15:16.763936 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:15:16.763936 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: from cryptography.utils import int_from_bytes Jun 23 09:15:16.766255 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:15:16.766255 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: from cryptography.utils import int_from_bytes Jun 23 09:15:16.766701 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:15:16.766701 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: from cryptography.utils import int_from_bytes Jun 23 09:15:19.283197 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 09:15:19.283842 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 09:15:19.283949 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 09:15:19.284302 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 09:15:19.284606 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 09:15:19.284991 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.285314 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.285628 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 09:15:19.285988 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.286078 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 09:15:19.286173 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.286259 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.286398 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 09:15:19.286555 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.286763 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 09:15:19.286868 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.287044 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 09:15:19.287203 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.287438 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.287535 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.287771 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.287862 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.288082 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.288171 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.288406 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-1-iscsi {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.288498 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.288728 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.288819 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289034 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289131 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289340 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289439 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289655 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289744 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.289960 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.290049 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.290231 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.290333 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.290550 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.290641 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.290878 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-1-iscsi {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.291099 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.291561 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.291692 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.291804 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.291915 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292065 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292188 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292387 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292501 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292600 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292754 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.292845 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.293060 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.293159 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.293377 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.293567 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.293675 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.293884 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294021 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294215 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294346 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294500 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294657 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-1-iscsi {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294844 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.294980 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.295187 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.295289 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.295497 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.295598 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.295819 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.295979 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.296133 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.296290 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.296459 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.296597 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.296757 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.296907 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.297153 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-1-iscsi {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.297271 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.297471 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.297562 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.297785 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.297924 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.298101 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.298191 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.298434 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.298531 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.298752 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.298843 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.299079 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.299170 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.299384 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.299477 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.299691 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.299782 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.300006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.300610 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.300838 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.300937 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.301147 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.301246 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.301397 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.301557 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.301702 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.301881 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302021 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302186 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302338 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302497 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302658 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302808 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.302926 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.303157 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.303303 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.303468 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.303572 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.303776 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.303866 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304029 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304121 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304340 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304445 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304658 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304801 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.304960 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305052 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305266 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305379 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305539 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305637 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305792 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.305903 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.306113 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.306205 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.306436 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.306534 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.306744 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.306833 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307073 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307178 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307376 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307465 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307684 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307782 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.307992 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.308083 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.308301 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.308400 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.308610 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.308709 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.308915 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309013 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309235 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309333 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309537 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309643 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309854 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.309944 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.310161 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.310251 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.310464 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.310563 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.310767 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.310858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.311103 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.311196 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.311420 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.311569 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.311742 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.311841 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312042 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312141 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312291 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312383 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312589 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312682 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312890 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.312981 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.313206 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.313297 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.313506 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.313596 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.313809 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.313903 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.314108 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.314200 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.314407 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.314505 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.314710 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.314801 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.315036 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.315132 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.315344 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.315472 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.315661 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.315815 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.316516 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.316612 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.316827 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.316934 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.317133 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.317242 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.317435 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.317530 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.317736 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.317830 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318044 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318158 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318351 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318447 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318653 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318753 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.318976 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319155 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319291 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319380 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319587 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319692 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319894 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.319999 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.320196 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.320301 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.320496 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.320590 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.320812 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.320914 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.321121 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.321224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.321424 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.321534 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.321727 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.321829 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322029 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322122 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322333 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322425 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322645 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322744 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.322975 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323072 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323270 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323361 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323584 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323677 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323887 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.323976 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.324188 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.324278 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.324486 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.324578 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.324784 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.324874 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325084 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325175 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325400 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325550 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325680 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325772 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.325977 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.326068 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.326274 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.326365 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.326584 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.326682 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.326891 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327054 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327520 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327610 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327822 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.327920 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.328126 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.328217 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.328428 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.328520 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.328731 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.328834 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.329029 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.329127 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.329347 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.329447 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.329669 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.329769 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.329977 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.330068 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.330284 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.330375 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.330590 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.330682 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.330941 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:15:19.331037 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.331277 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.331387 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.331611 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.331749 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.331922 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332013 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332232 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332330 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332550 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332642 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332866 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.332957 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.333194 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.333285 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.333507 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.333607 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.333822 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.333911 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.334137 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.334241 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.334447 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.334557 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.334756 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.334848 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.335097 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.335206 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.335419 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.335526 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.335728 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.335821 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.336061 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.336164 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.336379 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.336471 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.336699 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.336798 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337020 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337166 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337333 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337433 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337641 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337731 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.337950 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.338050 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.338257 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.338356 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.338578 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.338668 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.338926 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.339037 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.339244 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.339335 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.339561 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.339709 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.339918 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340010 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340169 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340262 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340477 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340576 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340785 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.340878 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.341097 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.341188 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.341421 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.341512 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.341731 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.341859 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342045 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342144 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342357 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342448 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342668 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342765 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.342998 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.343093 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.343311 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.343415 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.343621 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.343719 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.343928 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344029 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344233 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344333 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344538 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344635 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344847 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.344938 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.345400 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.345507 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.345725 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.345816 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.346037 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.346135 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.346344 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.346448 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.346655 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.346746 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347014 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347106 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347328 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347439 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347638 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347730 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.347945 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348035 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348252 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348352 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348561 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348659 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348871 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.348961 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.349178 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.349278 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.349503 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.349594 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.349811 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.349902 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.350113 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.350204 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.350427 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.350519 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.350730 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.350820 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351060 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351154 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351375 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351465 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351686 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351790 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.351993 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.352090 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.352301 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.352399 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.352609 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.352714 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.352918 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353008 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353232 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353322 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353541 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353645 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353851 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.353949 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.354168 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.354260 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.354480 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.354581 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.354796 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.354894 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.355134 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.355226 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.355447 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.355580 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.355775 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.355868 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356093 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356184 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356397 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356496 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356699 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356833 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.356999 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357090 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357304 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357402 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357605 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357703 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357908 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.357999 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.358208 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.358299 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.358509 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.358607 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.358835 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.358963 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.359180 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.359272 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.359485 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.359574 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.359783 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.359887 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360087 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360185 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360388 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360480 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360692 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360792 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.360999 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.361091 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.361306 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.361398 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.361610 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.361710 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.361934 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.362033 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.362244 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.362336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.363084 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.363187 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.363397 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.363574 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.363704 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.363889 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.364050 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.364227 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.364358 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.364513 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.364707 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.364827 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.365054 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.365151 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.365376 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.365468 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.365704 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.365796 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366022 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366122 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366342 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366435 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366650 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366750 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.366984 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.367076 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.367291 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.367421 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.367603 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.367703 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.367926 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368017 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368240 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368331 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368556 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368654 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368866 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.368956 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.369176 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.369266 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.369490 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.369661 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.369798 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.369890 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.370105 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.370195 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.370412 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.370511 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.370720 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.370811 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.371068 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.371163 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.371380 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.371472 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.371695 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.371786 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372004 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372094 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372327 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372418 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372632 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372722 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.372944 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373034 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373246 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373336 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373557 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373654 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373879 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.373970 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.374193 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.374285 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.374502 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.374592 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.374811 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.374932 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.375154 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.375247 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.375465 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.375557 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.375771 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.375871 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376081 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376173 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376386 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376477 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376691 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376796 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.376998 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.377088 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.377311 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.377403 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.377619 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.377728 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.377925 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.378015 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.378278 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.378373 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.378594 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.378687 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.378903 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379056 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379229 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379320 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379533 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379626 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379844 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.379934 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.380162 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.380252 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.380471 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.380563 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.380786 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.380878 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.381095 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.381186 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.381400 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.381490 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.381704 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.381803 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382008 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382162 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382314 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382413 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382614 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382703 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.382935 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383043 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383334 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383577 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383675 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383887 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.383990 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.384192 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.384284 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.384496 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.384585 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.384814 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.384913 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.385126 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.385224 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.385430 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.385522 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.385738 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.385876 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.386043 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.386178 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.386365 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.386456 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.386679 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.386772 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387013 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387152 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387326 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387416 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387635 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387728 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.387946 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388038 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388257 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388349 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388571 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388663 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388877 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.388967 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.389187 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.389278 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.389497 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.389589 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.389802 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.389893 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.390113 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.390213 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.390425 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.390516 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.390742 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391016 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391111 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391350 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391443 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391665 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391764 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.391985 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.392113 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.392304 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.392396 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.392613 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.392706 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.392930 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.393031 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.393252 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.393345 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.393589 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.394338 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.394451 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.394676 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.394776 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395029 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395124 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395428 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395645 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395746 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.395949 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396047 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396254 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396346 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396557 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396721 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396852 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.396945 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.397155 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.397256 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.397458 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.397559 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.397761 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.397862 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.398064 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.398156 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.398375 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.398467 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.398678 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.398770 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399009 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399103 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399313 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399405 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399632 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399725 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.399936 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400026 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400236 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400327 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400537 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400629 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400838 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.400929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.401152 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.401256 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.401460 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.401553 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.401773 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.401873 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.402083 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.402184 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.402453 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.402560 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.402721 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.402823 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403048 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403158 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403355 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403454 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403661 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403753 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.403962 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404053 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404264 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404355 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404573 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404665 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404881 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.404973 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.405182 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.405273 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.405491 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.405582 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.405799 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.405893 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.406108 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.406200 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.406415 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.406506 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.406714 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.406807 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407043 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407140 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407347 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407452 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407659 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407751 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.407966 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408065 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408270 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408371 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408574 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408666 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408881 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.408972 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.409188 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.409289 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.409538 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.409631 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.409851 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.409941 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.410152 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.410256 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.410469 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.410559 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.410770 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.410860 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.411108 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.411201 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.411410 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.411501 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.411719 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.411818 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412028 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412110 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412331 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412418 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412639 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412719 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.412948 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413029 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413250 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413329 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413553 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413641 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413857 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.413938 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.414158 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.414237 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.414459 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.414548 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.414770 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.414850 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.415104 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.415210 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.415420 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.415508 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.415724 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.415804 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.416031 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.416111 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.416337 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.416452 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.416649 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.416956 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.417054 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.417263 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.417511 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.417612 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.417885 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.418062 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.418203 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.418514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.418625 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.418824 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.419151 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.419296 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.419461 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.419768 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.419895 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.420079 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.420385 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.420476 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.420691 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.420996 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.421097 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.421301 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.421609 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.421700 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.421936 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.422186 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.422287 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.422540 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.422762 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.422867 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.423160 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.423370 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.423505 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.423813 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.423954 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.424174 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.424482 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.424650 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.424806 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.425150 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.425241 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.425465 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.425777 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.425877 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.426092 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.426376 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.426517 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.426700 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.427007 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.427116 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.427338 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.427626 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.427718 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.427935 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.428207 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.428324 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.428562 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.428806 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.428899 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.429186 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.429411 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.429504 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.429828 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.429975 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.430135 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.430391 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.430492 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.430746 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.430846 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.431081 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.431329 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.431421 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.431655 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.431748 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.431974 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.432065 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.432286 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.432384 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.432600 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.432692 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.432913 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433017 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433226 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433332 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433534 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433634 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433844 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.433936 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.434155 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.434257 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.434462 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.434561 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.434779 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.434870 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.435115 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.435221 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.435423 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.435522 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.435734 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.435834 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436035 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436135 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436347 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436440 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436653 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436746 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.436965 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.437087 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.437277 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.437402 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.437587 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.437714 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.437896 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438021 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438209 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438333 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438516 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438644 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438842 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.438967 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.439184 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.439278 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.439492 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.439583 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.439800 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.439986 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.440105 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.440299 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.440419 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.440611 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.441266 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.441456 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.441699 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.441792 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442014 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442115 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442326 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442417 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442633 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442725 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.442966 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443074 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443276 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443375 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443583 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443683 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443897 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.443997 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.444200 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.444291 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.444525 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.444618 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.444912 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445003 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445223 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445323 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445533 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445625 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445838 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.445931 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.446142 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.446233 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.446450 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.446549 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.446775 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.446869 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.447108 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.447204 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.447415 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.447506 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.447722 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.447814 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.448045 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.448137 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.448351 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.448454 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.448672 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.448763 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449032 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449122 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449348 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449453 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449760 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.449975 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.450078 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.450304 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.450397 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.450631 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.450733 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.450974 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.451071 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.451303 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.451408 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.451633 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.451738 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.451939 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452031 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452253 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452345 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452562 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452888 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.452981 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.453212 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.453305 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.453522 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.453615 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.453837 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.453929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.454143 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.454234 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.454453 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.454555 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.454774 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.454866 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.455106 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.455200 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.455423 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.455516 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.455738 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.455831 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.456050 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.456192 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.457118 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.457227 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.457439 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.457742 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.457893 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.458152 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.458289 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.458484 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.458803 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.458895 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.459379 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.459487 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.459719 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.459913 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.460114 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.460437 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.460539 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.460752 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.460993 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.461094 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.461359 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.461589 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.461681 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.462123 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.462226 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.462567 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.462661 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.462896 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.463258 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.463354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.463596 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.463698 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.463913 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.464006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.464254 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.464342 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.464586 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.464680 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.464909 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465010 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465232 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465326 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465563 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465654 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465874 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.465966 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.466184 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.466277 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.466499 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.466600 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.466810 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.466965 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.467145 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.467284 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.467454 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.467557 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.467764 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.467866 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.468071 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.468162 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.468379 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.468472 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.468686 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.468822 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469014 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469107 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469322 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469414 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469647 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469749 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.469961 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.470059 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.470518 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.470620 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.470828 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.470947 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.471157 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.471250 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.471505 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.471609 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.471815 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.471927 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.472173 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.472265 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.472485 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.472577 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.472800 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.472893 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.473108 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.473201 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.473416 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.473508 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.473725 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.473825 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474038 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474132 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474342 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474443 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474649 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474741 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.474974 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.475070 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.475300 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.475404 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.475607 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.475701 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.475933 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476246 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476417 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476548 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476649 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476855 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.476955 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.477159 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.477261 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.477504 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.477694 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.477796 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.478031 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.478132 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.478352 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.478481 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.478674 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.478767 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479019 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479129 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479342 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479436 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479660 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479753 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.479977 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.480083 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.480295 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.480389 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.480609 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.480709 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.480923 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481028 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481244 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481337 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481558 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481658 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481873 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.481983 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.482181 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.482274 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.482498 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.482590 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.482811 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.482905 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.483225 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.483321 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.483545 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.483755 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.483927 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.484081 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.484212 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.484392 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.484531 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.484705 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.484831 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485015 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485150 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485328 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485475 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485640 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485790 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.485950 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.486106 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.486257 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.486423 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.486566 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.486741 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.486874 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.487081 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.487224 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.487397 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.487565 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.487739 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.487892 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.488058 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.488225 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.488384 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.488541 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.488726 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.488855 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.489052 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.489154 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.489373 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.489466 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.489690 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.489811 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.490010 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.490112 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.490416 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.490529 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.490730 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.490831 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.491068 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.491209 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.491389 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.491540 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.491701 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.491869 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492012 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492190 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492326 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492509 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492639 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492837 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.492943 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.493147 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.493240 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.493456 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.493549 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.493769 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.493871 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.494080 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.494173 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.494389 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.494481 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.494712 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.494816 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495047 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495144 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495359 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495452 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495682 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495776 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.495993 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.496208 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.496520 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.496612 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.496855 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.496952 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.497176 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.497274 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.497497 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.497588 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.497812 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.497905 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.498125 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.498255 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.498435 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.498541 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.498743 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.498843 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499081 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499176 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499390 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499495 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499695 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499786 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.499999 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.500092 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.500311 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.500412 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.500616 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.500707 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.500917 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.501011 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.501226 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.501327 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.501532 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.501623 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.501842 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.502061 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.502162 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.502412 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.502504 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.502731 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.502824 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.503073 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.503695 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.503904 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.503997 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.504216 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.504308 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.504522 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.504625 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.504829 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.504929 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.505135 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.505234 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.505440 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.505541 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.505753 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.505845 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.506060 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.506153 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.506369 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.506463 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.506679 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.506771 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507015 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507110 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507323 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507416 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507628 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507723 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.507935 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508029 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508237 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508374 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508562 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508662 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508867 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.508958 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.509170 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.509264 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.509472 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.509564 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.509780 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.509881 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.510081 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.510173 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.510381 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.510474 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.510683 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.510789 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.511006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.511102 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.511324 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.511576 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.511670 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.511915 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512009 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512214 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512305 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512520 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512613 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512822 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.512916 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.513128 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.513221 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.513473 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.513637 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.513783 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.513877 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.514081 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.514172 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.514383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.514493 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.514694 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.514794 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515021 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515118 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515344 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515449 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515654 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515746 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.515963 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.516063 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.516275 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.516382 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.516585 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.516679 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.516894 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.517117 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.517219 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.517452 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.517552 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.517771 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.517863 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.518093 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.518195 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.518411 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.518504 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.518715 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.518900 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.519600 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.519704 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.519910 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520002 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520235 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520330 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520542 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520635 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520849 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.520950 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.521160 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.521262 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.521468 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.521561 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.521775 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.521867 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.522085 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.522178 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.522392 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.522493 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.522699 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.522792 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523030 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523143 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523340 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523480 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523646 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523739 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.523951 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.524053 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.524257 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.524349 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.524567 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.524661 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.524906 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525009 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525222 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525324 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525538 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.525951 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.526163 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.526256 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.526475 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.526567 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.526783 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.526876 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.527115 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.527216 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.527424 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.527517 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.527739 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.527839 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528066 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528167 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528372 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528472 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528674 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528766 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.528994 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.529085 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.529304 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.529406 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.529613 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.529706 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.529922 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530022 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530233 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530339 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530541 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530633 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530850 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.530995 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.531182 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.531285 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.531490 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.531583 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.531800 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.531893 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.532106 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.532199 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.532411 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.532503 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.532718 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.532818 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533023 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533116 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533326 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533418 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533721 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.533939 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.534070 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.534240 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.534340 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.534571 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.534675 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.534880 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535005 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535207 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535300 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535509 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535609 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535818 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.535920 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.536120 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.536220 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.536422 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.536529 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.536723 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.536816 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537024 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537116 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537329 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537429 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537629 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537721 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.537928 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538024 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538227 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538321 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538528 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538657 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538828 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.538938 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.539152 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.539247 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.539458 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.539550 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.539758 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.539851 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540060 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540154 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540360 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540460 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540659 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540751 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.540957 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.541051 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.541292 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.541392 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.541618 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.541719 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.541928 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.542029 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.542247 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.542339 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.542556 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.542724 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.542876 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543016 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543207 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543299 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543516 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543621 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543836 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.543936 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.544148 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.544248 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.544454 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.544555 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.544773 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.544864 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.545076 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.545177 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.545385 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.545479 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.545693 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.545786 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546002 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546094 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546309 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546403 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546617 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546710 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.546937 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.547033 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.547275 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.547368 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.547606 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.547707 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.547937 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548038 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548253 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548345 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548569 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548661 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548882 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.548988 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.549191 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.549311 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.549577 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.549705 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.549887 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.549989 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.550156 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 09:15:19.550252 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.550513 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.550822 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.551171 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.551488 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.551801 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.552126 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.552454 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.552761 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.553085 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.553430 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.553781 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.554091 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.554433 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.554763 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.555104 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.555416 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.555721 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:15:19.555964 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 09:15:19.703525 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO dbcounter [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Registered counter for database nova_api Jun 23 09:15:19.711863 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO dbcounter [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Registered counter for database nova_api Jun 23 09:15:19.724943 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_db.sqlalchemy.engines [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.731440 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writer thread running {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.731806 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_db.sqlalchemy.engines [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.738726 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writer thread running {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.788866 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.context [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad430a24-c3fd-4ac3-a88b-78701c74d764(cell1) {{(pid=103985) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 09:15:19.792805 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:15:19.794412 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:15:19.794714 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.context [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad430a24-c3fd-4ac3-a88b-78701c74d764(cell1) {{(pid=103986) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 09:15:19.795404 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:15:19.797334 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:15:19.798603 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_concurrency.lockutils [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:15:19.799444 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO dbcounter [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Registered counter for database nova_cell0 Jun 23 09:15:19.800789 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_concurrency.lockutils [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:15:19.801614 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_concurrency.lockutils [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:15:19.803596 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_concurrency.lockutils [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:15:19.805000 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO dbcounter [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Registered counter for database nova_cell1 Jun 23 09:15:19.805575 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO dbcounter [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Registered counter for database nova_cell0 Jun 23 09:15:19.809565 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO dbcounter [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Registered counter for database nova_cell1 Jun 23 09:15:19.812073 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_db.sqlalchemy.engines [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.813689 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_db.sqlalchemy.engines [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.816895 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_db.sqlalchemy.engines [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.818320 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_db.sqlalchemy.engines [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.820531 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writer thread running {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.822001 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writer thread running {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.824509 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writer thread running {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.826749 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writer thread running {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.967267 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO dbcounter [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Registered counter for database nova_cell0 Jun 23 09:15:19.969812 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO dbcounter [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Registered counter for database nova_cell0 Jun 23 09:15:19.974238 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_db.sqlalchemy.engines [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.978487 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG oslo_db.sqlalchemy.engines [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:15:19.978642 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writer thread running {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:19.982776 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writer thread running {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:15:20.399900 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: WARNING keystonemiddleware.auth_token [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:15:20.407230 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: WARNING keystonemiddleware.auth_token [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:15:20.433823 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: WARNING keystonemiddleware.auth_token [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:15:20.441536 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: WARNING keystonemiddleware.auth_token [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:15:20.749501 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: WARNING keystonemiddleware.auth_token [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:15:20.755521 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: WARNING keystonemiddleware.auth_token [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:15:20.760789 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642add889c0 pid: 103985 (default app) Jun 23 09:15:20.762858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:15:20.764063 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Jun 23 09:15:20.764469 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu Jun 23 09:15:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:15:20.779674 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: WARNING keystonemiddleware.auth_token [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:15:20.786159 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: WARNING keystonemiddleware.auth_token [None req-df9fbd47-a468-498f-80d0-194adf7af559 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:15:20.791490 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642add889c0 pid: 103986 (default app) Jun 23 09:16:38.789928 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:38.791647 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Jun 23 09:16:38.793016 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:38.804866 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writing DB stats nova_api:SELECT=3 {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:38.806118 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writing DB stats nova_cell0:SELECT=3 {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:38.806941 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writing DB stats nova_cell1:SELECT=3 {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:38.808061 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:39.263632 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-5d856c30-ea2b-4817-8c55-6935761fceba admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:39.292795 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-5d856c30-ea2b-4817-8c55-6935761fceba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.493575 Jun 23 09:16:39.293525 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jun 23 09:16:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:16:41.356454 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:41.357985 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-43c88a96-35a1-4e3d-a1e8-3ae4da84f0f0 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Jun 23 09:16:41.358383 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:41.417200 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-3ec26d2b-0aff-46b5-9a09-d72a83856dff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:41.435429 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:16:41.435429 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: warnings.warn(msg) Jun 23 09:16:41.553309 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-3ec26d2b-0aff-46b5-9a09-d72a83856dff admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.188249 Jun 23 09:16:41.554241 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:16:41.569135 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_api:SELECT=3 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:41.570127 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_cell0:SELECT=3 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:41.571605 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_cell1:SELECT=3 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:41.572472 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:41.779054 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-f68dd62b-4af2-4abb-9ea7-f8875838aeaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:41.781349 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:16:41.781349 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: warnings.warn(msg) Jun 23 09:16:41.981566 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-f68dd62b-4af2-4abb-9ea7-f8875838aeaa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.418452 Jun 23 09:16:41.982342 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jun 23 09:16:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:16:44.100581 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-3ec26d2b-0aff-46b5-9a09-d72a83856dff admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:44.101691 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-3ec26d2b-0aff-46b5-9a09-d72a83856dff admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jun 23 09:16:44.102111 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:44.215374 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-e9d952ba-f2ec-4109-8fdf-62e363bba41e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:44.239352 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:16:44.239352 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: warnings.warn(msg) Jun 23 09:16:44.330147 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-e9d952ba-f2ec-4109-8fdf-62e363bba41e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.221962 Jun 23 09:16:44.330705 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:16:44.343203 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ca480b60-7b51-4427-854d-df87efd12bab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:44.344624 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:16:44.344624 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: warnings.warn(msg) Jun 23 09:16:44.463856 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ca480b60-7b51-4427-854d-df87efd12bab admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124696 Jun 23 09:16:44.464505 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jun 23 09:16:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:16:46.537128 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-e9d952ba-f2ec-4109-8fdf-62e363bba41e admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:46.538141 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-e9d952ba-f2ec-4109-8fdf-62e363bba41e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 23 09:16:46.538540 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:46.600324 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-10430e1e-b21a-4146-830d-690b3a95d6ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:46.684433 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-10430e1e-b21a-4146-830d-690b3a95d6ee admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139877 Jun 23 09:16:46.685351 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:16:46.697789 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-f41f17e9-5732-4a11-a34c-08bf28058b34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:46.804633 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-f41f17e9-5732-4a11-a34c-08bf28058b34 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110690 Jun 23 09:16:46.805542 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jun 23 09:16:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:16:48.900452 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-10430e1e-b21a-4146-830d-690b3a95d6ee admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:48.901503 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-10430e1e-b21a-4146-830d-690b3a95d6ee admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 23 09:16:48.902059 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:48.961022 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-98b7a413-4175-4d98-84a3-764a89737b63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:49.044367 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-98b7a413-4175-4d98-84a3-764a89737b63 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135750 Jun 23 09:16:49.044367 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 09:16:49.056504 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-124368d0-5dce-40c2-8ff9-6c489dd1a31a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:49.143994 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-124368d0-5dce-40c2-8ff9-6c489dd1a31a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091104 Jun 23 09:16:49.144567 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jun 23 09:16:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:16:51.297380 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-98b7a413-4175-4d98-84a3-764a89737b63 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:51.299082 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-98b7a413-4175-4d98-84a3-764a89737b63 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Jun 23 09:16:51.299783 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:16:51.359658 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-70a83946-168f-42c0-b47c-a132d318a1e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:51.454426 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-70a83946-168f-42c0-b47c-a132d318a1e3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148757 Jun 23 09:16:51.455819 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:16:51.467550 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-1eb9101e-0a51-40be-88b2-5446cb392880 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:51.578874 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-1eb9101e-0a51-40be-88b2-5446cb392880 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114894 Jun 23 09:16:51.579631 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jun 23 09:16:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:16:53.656362 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-70a83946-168f-42c0-b47c-a132d318a1e3 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:53.657377 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-70a83946-168f-42c0-b47c-a132d318a1e3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 23 09:16:53.659079 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:53.715849 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-04786bb5-7a1c-47a1-bef9-f75b9e9c83c7 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:53.739257 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-04786bb5-7a1c-47a1-bef9-f75b9e9c83c7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074650 Jun 23 09:16:53.739789 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jun 23 09:16:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:16:55.882907 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-70a83946-168f-42c0-b47c-a132d318a1e3 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:55.883946 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-70a83946-168f-42c0-b47c-a132d318a1e3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 23 09:16:55.884397 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:16:55.945858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-c0d2ca9b-a2f9-4e40-bbec-f9791b7a8ff2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:56.022249 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-c0d2ca9b-a2f9-4e40-bbec-f9791b7a8ff2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.132020 Jun 23 09:16:56.022938 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:16:56.035110 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-6df260b1-4cba-4a89-85bd-6387341a738d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:56.140095 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-6df260b1-4cba-4a89-85bd-6387341a738d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108557 Jun 23 09:16:56.140931 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jun 23 09:16:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:16:58.440501 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-c0d2ca9b-a2f9-4e40-bbec-f9791b7a8ff2 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:16:58.441433 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-c0d2ca9b-a2f9-4e40-bbec-f9791b7a8ff2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Jun 23 09:16:58.441836 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:16:58.518855 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-57ae0e50-3532-4e7a-b8c4-363ca4973ebe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "vcpus": 1}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:58.586783 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-57ae0e50-3532-4e7a-b8c4-363ca4973ebe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.136727 Jun 23 09:16:58.587405 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:16:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:16:58.600080 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-2276d8b9-15fd-40bb-9d56-b0100830da77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:16:58.687425 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-2276d8b9-15fd-40bb-9d56-b0100830da77 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091326 Jun 23 09:16:58.688045 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jun 23 09:16:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:17:00.920614 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-57ae0e50-3532-4e7a-b8c4-363ca4973ebe admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:00.921637 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-57ae0e50-3532-4e7a-b8c4-363ca4973ebe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 23 09:17:00.922045 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:17:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:17:00.984034 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-b6617044-1fc9-4f26-98ed-a0379dec3499 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:01.062340 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-b6617044-1fc9-4f26-98ed-a0379dec3499 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.132217 Jun 23 09:17:01.063056 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:17:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:01.076609 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-c2c4a1f3-53b9-44e4-8a8d-62af61814137 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:01.150371 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-c2c4a1f3-53b9-44e4-8a8d-62af61814137 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077404 Jun 23 09:17:01.151262 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jun 23 09:17:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:17:03.227511 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-b6617044-1fc9-4f26-98ed-a0379dec3499 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:03.228451 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-b6617044-1fc9-4f26-98ed-a0379dec3499 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 23 09:17:03.228854 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:03.287217 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-23c2c37e-c081-47e4-9570-cbce65493d5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "vcpus": 4, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:03.363503 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-23c2c37e-c081-47e4-9570-cbce65493d5e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128755 Jun 23 09:17:03.364089 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:17:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:03.375695 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-da108a6e-850e-46fa-9055-ada702ce94cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:03.457184 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-da108a6e-850e-46fa-9055-ada702ce94cc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085106 Jun 23 09:17:03.457931 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jun 23 09:17:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:17:05.575704 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-23c2c37e-c081-47e4-9570-cbce65493d5e admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:05.577376 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-23c2c37e-c081-47e4-9570-cbce65493d5e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002200 Jun 23 09:17:05.577781 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:05.642052 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-47b5e2f0-d43b-4d49-8757-e60124d1557c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:05.760888 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-47b5e2f0-d43b-4d49-8757-e60124d1557c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.176535 Jun 23 09:17:05.761375 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jun 23 09:17:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:05.774427 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-6bd257d5-3890-42bf-a38e-5c39f12d624c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:05.904072 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-6bd257d5-3890-42bf-a38e-5c39f12d624c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133646 Jun 23 09:17:05.904885 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jun 23 09:17:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:17:30.969574 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-47b5e2f0-d43b-4d49-8757-e60124d1557c admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:30.971093 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-47b5e2f0-d43b-4d49-8757-e60124d1557c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 23 09:17:30.971490 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:30.982004 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:31.030703 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-45f87320-0e04-4513-980e-3db093237d0c admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:31.047257 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-45f87320-0e04-4513-980e-3db093237d0c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069645 Jun 23 09:17:31.047728 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jun 23 09:17:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:31.956484 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-47b5e2f0-d43b-4d49-8757-e60124d1557c admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:31.957480 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-47b5e2f0-d43b-4d49-8757-e60124d1557c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 23 09:17:31.957879 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:32.148273 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-a96192ab-a950-4c4c-8fe8-c6f94bbb18f0 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:32.153760 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.wsgi [None req-a96192ab-a950-4c4c-8fe8-c6f94bbb18f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-a96192ab-a950-4c4c-8fe8-c6f94bbb18f0 admin admin] Request method failure captured: Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Accept: application/json Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Accept-Encoding: gzip, deflate Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Connection: keep-alive Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Content-Length: 0 Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Host: 10.222.0.52 Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Openstack-Api-Version: compute 2.90 Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Openstack-System-Scope: None Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: User-Agent: python-novaclient Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Auth-Token: gAAAAABitC-r7YMUu-g9Vjg2LNHgGRJC9AvJsIhaMyoFc2TqjLVn7r4X9F_j2WDaIczvsbvdQe-e_kogyjiMwH4E7E5rtGcs7EQscfuXqK3k6GAMzxmDIZHxQBjV-VGyxIfpXIcxOZsttQJJciMQD0U7qDIEG3uun5-Qz3NC1uFDByqIH7AHRRc Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Domain-Id: None Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Domain-Name: None Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Identity-Status: Confirmed Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Is-Admin-Project: True Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Domain-Id: default Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Domain-Name: Default Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Name: admin Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Role: admin,reader,member Jun 23 09:17:32.159242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Roles: admin,reader,member Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5fa9b7cbdd44d0c8b5ffa0c15d81646", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant: admin Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant-Name: admin Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User: admin Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Domain-Id: default Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Domain-Name: Default Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Id: 261a7891b0d244a3a8e71c73d6ba80b6 Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Name: admin Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: method: > Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: exception: Flavor 42 could not be found. Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: action_args: {'id': '42'} Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:17:32.161383 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:32.162336 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.163612 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-a96192ab-a950-4c4c-8fe8-c6f94bbb18f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:17:32.164853 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-a96192ab-a950-4c4c-8fe8-c6f94bbb18f0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063047 Jun 23 09:17:32.164853 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jun 23 09:17:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:32.168604 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-848d9ab5-4544-412f-ad4e-e0b569cd2e43 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:32.171704 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:32.191173 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-848d9ab5-4544-412f-ad4e-e0b569cd2e43 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026116 Jun 23 09:17:32.191740 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jun 23 09:17:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:32.201405 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-105f8ca3-73bc-41da-868d-a5c6ece648b9 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:32.225021 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-105f8ca3-73bc-41da-868d-a5c6ece648b9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027249 Jun 23 09:17:32.225557 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jun 23 09:17:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:32.235344 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-34d94e79-919d-481a-b9a7-553eb6bb1ebd admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:32.241559 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.wsgi [None req-34d94e79-919d-481a-b9a7-553eb6bb1ebd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-34d94e79-919d-481a-b9a7-553eb6bb1ebd admin admin] Request method failure captured: Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Accept: application/json Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Accept-Encoding: gzip, deflate Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Connection: keep-alive Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Content-Length: 0 Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Host: 10.222.0.52 Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Openstack-Api-Version: compute 2.90 Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Openstack-System-Scope: None Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: User-Agent: python-novaclient Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Auth-Token: gAAAAABitC-r7YMUu-g9Vjg2LNHgGRJC9AvJsIhaMyoFc2TqjLVn7r4X9F_j2WDaIczvsbvdQe-e_kogyjiMwH4E7E5rtGcs7EQscfuXqK3k6GAMzxmDIZHxQBjV-VGyxIfpXIcxOZsttQJJciMQD0U7qDIEG3uun5-Qz3NC1uFDByqIH7AHRRc Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Domain-Id: None Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Domain-Name: None Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Identity-Status: Confirmed Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Is-Admin-Project: True Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Domain-Id: default Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Domain-Name: Default Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Name: admin Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Role: admin,reader,member Jun 23 09:17:32.244858 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Roles: admin,reader,member Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5fa9b7cbdd44d0c8b5ffa0c15d81646", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant: admin Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant-Name: admin Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User: admin Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Domain-Id: default Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Domain-Name: Default Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Id: 261a7891b0d244a3a8e71c73d6ba80b6 Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Name: admin Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: method: > Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: exception: Flavor 42 could not be found. Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: action_args: {'id': '42'} Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:17:32.246598 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:32.252745 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:32.254218 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-34d94e79-919d-481a-b9a7-553eb6bb1ebd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:17:32.255636 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-34d94e79-919d-481a-b9a7-553eb6bb1ebd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014734 Jun 23 09:17:32.255636 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jun 23 09:17:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:33.074142 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-105f8ca3-73bc-41da-868d-a5c6ece648b9 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:33.075175 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-105f8ca3-73bc-41da-868d-a5c6ece648b9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 23 09:17:33.075570 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:33.263255 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-4784cd6f-a889-4f34-bc22-527efc645b4e admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:33.269503 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.wsgi [None req-4784cd6f-a889-4f34-bc22-527efc645b4e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-4784cd6f-a889-4f34-bc22-527efc645b4e admin admin] Request method failure captured: Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Accept: application/json Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Accept-Encoding: gzip, deflate Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Connection: keep-alive Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Content-Length: 0 Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Host: 10.222.0.52 Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Openstack-Api-Version: compute 2.90 Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Openstack-System-Scope: None Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: User-Agent: python-novaclient Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Auth-Token: gAAAAABitC-tRKlVSfkCFFz8wyHRuvbq_PmmWqcGZ-FruTdu7uaQ6kay4eJV3srAegJ59_TSss_6KoljngtiYHoB42qzkjTSdESs1jLeKilC1Oi7ybO9PVf8AlC52SPvr_iWoTYlmXOq9b5hADHHo1gkjE8IaftoGbmQVhhCW9GZru2ETnNKqJg Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Domain-Id: None Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Domain-Name: None Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Identity-Status: Confirmed Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Is-Admin-Project: True Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Domain-Id: default Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Domain-Name: Default Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Name: admin Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Role: admin,reader,member Jun 23 09:17:33.271025 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Roles: admin,reader,member Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5fa9b7cbdd44d0c8b5ffa0c15d81646", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant: admin Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant-Name: admin Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User: admin Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Domain-Id: default Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Domain-Name: Default Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Id: 261a7891b0d244a3a8e71c73d6ba80b6 Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Name: admin Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: method: > Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: exception: Flavor 84 could not be found. Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: action_args: {'id': '84'} Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:17:33.272630 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:33.273667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.280929 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-4784cd6f-a889-4f34-bc22-527efc645b4e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:17:33.282319 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-4784cd6f-a889-4f34-bc22-527efc645b4e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060496 Jun 23 09:17:33.282319 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jun 23 09:17:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:33.282482 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-70971b3a-720e-4097-b961-bb58ccd27920 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:33.295595 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-70971b3a-720e-4097-b961-bb58ccd27920 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017280 Jun 23 09:17:33.296111 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jun 23 09:17:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:33.306127 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-d84110dc-7830-4881-a895-3ed7bc841f1d admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:33.321971 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-d84110dc-7830-4881-a895-3ed7bc841f1d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019663 Jun 23 09:17:33.322490 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jun 23 09:17:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:33.331491 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-497ec4dd-1b07-4606-ac81-4a5a0b191651 admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:33.336744 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.wsgi [None req-497ec4dd-1b07-4606-ac81-4a5a0b191651 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-497ec4dd-1b07-4606-ac81-4a5a0b191651 admin admin] Request method failure captured: Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Accept: application/json Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Accept-Encoding: gzip, deflate Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Connection: keep-alive Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Content-Length: 0 Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Host: 10.222.0.52 Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Openstack-Api-Version: compute 2.90 Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Openstack-System-Scope: None Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: User-Agent: python-novaclient Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Auth-Token: gAAAAABitC-tRKlVSfkCFFz8wyHRuvbq_PmmWqcGZ-FruTdu7uaQ6kay4eJV3srAegJ59_TSss_6KoljngtiYHoB42qzkjTSdESs1jLeKilC1Oi7ybO9PVf8AlC52SPvr_iWoTYlmXOq9b5hADHHo1gkjE8IaftoGbmQVhhCW9GZru2ETnNKqJg Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Domain-Id: None Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Domain-Name: None Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Identity-Status: Confirmed Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Is-Admin-Project: True Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Domain-Id: default Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Domain-Name: Default Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Name: admin Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Role: admin,reader,member Jun 23 09:17:33.338242 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Roles: admin,reader,member Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5fa9b7cbdd44d0c8b5ffa0c15d81646", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant: admin Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant-Name: admin Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User: admin Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Domain-Id: default Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Domain-Name: Default Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Id: 261a7891b0d244a3a8e71c73d6ba80b6 Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Name: admin Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: method: > Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: exception: Flavor 84 could not be found. Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: action_args: {'id': '84'} Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:17:33.339916 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:33.341006 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:33.342354 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-497ec4dd-1b07-4606-ac81-4a5a0b191651 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:17:33.343748 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-497ec4dd-1b07-4606-ac81-4a5a0b191651 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011589 Jun 23 09:17:33.343748 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jun 23 09:17:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:34.156365 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-d84110dc-7830-4881-a895-3ed7bc841f1d admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:34.157367 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-d84110dc-7830-4881-a895-3ed7bc841f1d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 23 09:17:34.157769 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:34.345130 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-85239f9d-0ba7-479d-9798-b271d9876cde admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:34.350694 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.wsgi [None req-85239f9d-0ba7-479d-9798-b271d9876cde admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-85239f9d-0ba7-479d-9798-b271d9876cde admin admin] Request method failure captured: Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Accept: application/json Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Accept-Encoding: gzip, deflate Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Connection: keep-alive Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Content-Length: 0 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Host: 10.222.0.52 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Openstack-Api-Version: compute 2.90 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Openstack-System-Scope: None Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: User-Agent: python-novaclient Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Auth-Token: gAAAAABitC-uUAElL1k8HagxQ6KTb6AQXC_xlmHtMT5ijRFUhusVz8ARfCBrP4OHV-lTZuwi9nSZSA8byO9107VxU0-jgZGhWXGXYe1x8_cQiyemOiOYSLSBqs6_yb1NMSApGzYRMf4HosChOEweIP7sTJTOwSJsskYeH9SXsDtm9HdawH3XkB4 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Domain-Id: None Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Domain-Name: None Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Identity-Status: Confirmed Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Is-Admin-Project: True Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Domain-Id: default Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Domain-Name: Default Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Project-Name: admin Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Role: admin,reader,member Jun 23 09:17:34.352235 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Roles: admin,reader,member Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5fa9b7cbdd44d0c8b5ffa0c15d81646", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant: admin Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-Tenant-Name: admin Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User: admin Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Domain-Id: default Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Domain-Name: Default Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Id: 261a7891b0d244a3a8e71c73d6ba80b6 Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: X-User-Name: admin Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: method: > Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: exception: Flavor 451 could not be found. Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: action_args: {'id': '451'} Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:17:34.353841 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:34.354851 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.356317 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-85239f9d-0ba7-479d-9798-b271d9876cde admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:17:34.357623 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-85239f9d-0ba7-479d-9798-b271d9876cde admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059615 Jun 23 09:17:34.357623 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jun 23 09:17:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:34.363632 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-f4ebb0ea-81ad-43f0-91db-d721e4d2fe5a admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:34.377624 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-f4ebb0ea-81ad-43f0-91db-d721e4d2fe5a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018002 Jun 23 09:17:34.378076 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jun 23 09:17:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:34.387634 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:34.400403 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016609 Jun 23 09:17:34.400923 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jun 23 09:17:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:17:34.410828 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-56b490a5-9456-401f-bc45-e38948c86242 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:34.416034 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.wsgi [None req-56b490a5-9456-401f-bc45-e38948c86242 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-56b490a5-9456-401f-bc45-e38948c86242 admin admin] Request method failure captured: Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Accept: application/json Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Accept-Encoding: gzip, deflate Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Connection: keep-alive Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Content-Length: 0 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Host: 10.222.0.52 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Openstack-Api-Version: compute 2.90 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Openstack-System-Scope: None Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: User-Agent: python-novaclient Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Auth-Token: gAAAAABitC-uUAElL1k8HagxQ6KTb6AQXC_xlmHtMT5ijRFUhusVz8ARfCBrP4OHV-lTZuwi9nSZSA8byO9107VxU0-jgZGhWXGXYe1x8_cQiyemOiOYSLSBqs6_yb1NMSApGzYRMf4HosChOEweIP7sTJTOwSJsskYeH9SXsDtm9HdawH3XkB4 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Domain-Id: None Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Domain-Name: None Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Identity-Status: Confirmed Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Is-Admin-Project: True Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Domain-Id: default Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Domain-Name: Default Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Project-Name: admin Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Role: admin,reader,member Jun 23 09:17:34.417514 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Roles: admin,reader,member Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5fa9b7cbdd44d0c8b5ffa0c15d81646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5fa9b7cbdd44d0c8b5ffa0c15d81646", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant: admin Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant-Id: e5fa9b7cbdd44d0c8b5ffa0c15d81646 Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-Tenant-Name: admin Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User: admin Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Domain-Id: default Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Domain-Name: Default Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Id: 261a7891b0d244a3a8e71c73d6ba80b6 Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: X-User-Name: admin Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: method: > Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: exception: Flavor 451 could not be found. Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: action_args: {'id': '451'} Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:17:34.419136 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:34.420224 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: ERROR nova.api.openstack.wsgi Jun 23 09:17:34.421575 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-56b490a5-9456-401f-bc45-e38948c86242 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:17:34.422857 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-56b490a5-9456-401f-bc45-e38948c86242 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012111 Jun 23 09:17:34.422857 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jun 23 09:17:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:35.247846 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:35.248830 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 23 09:17:35.249226 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:35.438110 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-b97360c7-1acd-4055-8f29-ef833e37c143 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:35.521881 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-b97360c7-1acd-4055-8f29-ef833e37c143 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.135543 Jun 23 09:17:35.522356 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jun 23 09:17:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:36.338323 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:36.339364 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 23 09:17:36.339779 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:36.528608 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-3ba8397d-8011-47f5-b1e8-394a3b6d9b44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:36.613308 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-3ba8397d-8011-47f5-b1e8-394a3b6d9b44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.134911 Jun 23 09:17:36.613846 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jun 23 09:17:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:37.445504 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:37.446502 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 23 09:17:37.446897 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:37.635721 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-9cf3bb89-8b4c-4a6e-9354-c3ae7d4f47ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:37.744883 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-9cf3bb89-8b4c-4a6e-9354-c3ae7d4f47ec admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.160555 Jun 23 09:17:37.745355 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jun 23 09:17:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:38.557673 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:38.558666 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 23 09:17:38.559103 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:38.757179 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-fd6c538e-5698-4965-8a56-4772f3c2d6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:17:38.869677 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-fd6c538e-5698-4965-8a56-4772f3c2d6bd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.168758 Jun 23 09:17:38.870220 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jun 23 09:17:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:17:39.683658 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:39.684676 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 09:17:39.685079 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:17:39.872510 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-e4019d4d-5a95-4fb4-9b98-cd56c8492e39 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:17:39.891187 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-e4019d4d-5a95-4fb4-9b98-cd56c8492e39 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069572 Jun 23 09:17:39.891725 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu Jun 23 09:17:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:18:26.728365 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:18:26.729359 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-ce5e96f2-8101-4999-b36e-29510715892a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 23 09:18:26.729757 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jun 23 09:18:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:18:26.740434 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:26.787524 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-5f72eb7d-3ebc-4349-b004-a6a5c5b7befa admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:18:26.806675 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-5f72eb7d-3ebc-4349-b004-a6a5c5b7befa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071229 Jun 23 09:18:26.815151 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jun 23 09:18:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:18:26.829929 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-7cfe6eba-c160-4e5b-a476-c34b392ba6ad admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:18:26.833335 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG dbcounter [-] [103986] Writing DB stats nova_api:SELECT=14 {{(pid=103986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:26.838166 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-7cfe6eba-c160-4e5b-a476-c34b392ba6ad admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011808 Jun 23 09:18:26.838677 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Jun 23 09:18:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:18:26.849863 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-0c859333-5e4a-42ff-b419-886e65569eed admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:18:26.857711 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-0c859333-5e4a-42ff-b419-886e65569eed admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011629 Jun 23 09:18:26.858226 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Jun 23 09:18:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:18:26.869750 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:18:26.877843 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011560 Jun 23 09:18:26.878362 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Jun 23 09:18:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:18:26.889152 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-5b4b4450-2ce9-46be-af45-783d473f57e2 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:18:26.896436 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-5b4b4450-2ce9-46be-af45-783d473f57e2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010705 Jun 23 09:18:26.896949 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Jun 23 09:18:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:21:51.615154 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:21:51.616194 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jun 23 09:21:51.616593 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:21:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:21:51.872092 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-0cac423b-5e50-4f61-84f9-2d5daa69b9c9 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:21:51.873249 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:21:51.873249 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: warnings.warn(msg) Jun 23 09:21:51.874976 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-0cac423b-5e50-4f61-84f9-2d5daa69b9c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:21:51.875424 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-0cac423b-5e50-4f61-84f9-2d5daa69b9c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:21:51.876241 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-0cac423b-5e50-4f61-84f9-2d5daa69b9c9 admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:21:51.876667 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-0cac423b-5e50-4f61-84f9-2d5daa69b9c9 admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:21:51.909940 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-0cac423b-5e50-4f61-84f9-2d5daa69b9c9 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151505 Jun 23 09:21:51.910486 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jun 23 09:21:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:21:52.735808 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:21:52.736816 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 23 09:21:52.737214 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:21:52.926393 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-1f40cb1f-7282-42a4-a79c-01680fb8f405 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:21:52.927582 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:21:52.927582 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: warnings.warn(msg) Jun 23 09:21:52.928746 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1f40cb1f-7282-42a4-a79c-01680fb8f405 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:21:52.929210 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1f40cb1f-7282-42a4-a79c-01680fb8f405 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:21:52.929980 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1f40cb1f-7282-42a4-a79c-01680fb8f405 admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:21:52.930528 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1f40cb1f-7282-42a4-a79c-01680fb8f405 admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:21:52.974683 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-1f40cb1f-7282-42a4-a79c-01680fb8f405 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.099221 Jun 23 09:21:52.975192 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jun 23 09:21:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:22:04.228794 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:22:04.230060 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Jun 23 09:22:04.230455 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:22:04.381511 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_cell0:SELECT=4 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:22:04.382226 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_cell1:SELECT=4 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:22:04.382857 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG dbcounter [-] [103985] Writing DB stats nova_api:SELECT=14 {{(pid=103985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:22:04.438894 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-fd42eb43-bc3e-4bf0-a8a3-cc0965e1f72d admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:22:04.440100 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:22:04.440100 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: warnings.warn(msg) Jun 23 09:22:04.441294 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-fd42eb43-bc3e-4bf0-a8a3-cc0965e1f72d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:22:04.441742 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-fd42eb43-bc3e-4bf0-a8a3-cc0965e1f72d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:22:04.442550 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-fd42eb43-bc3e-4bf0-a8a3-cc0965e1f72d admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:22:04.443005 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-fd42eb43-bc3e-4bf0-a8a3-cc0965e1f72d admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:22:04.468347 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-fd42eb43-bc3e-4bf0-a8a3-cc0965e1f72d admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091362 Jun 23 09:22:04.468893 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jun 23 09:22:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:22:05.294569 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: DEBUG nova.api.openstack.wsgi [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] Calling method '>' {{(pid=103986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:22:05.296210 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: INFO nova.api.openstack.requestlog [None req-99637b08-3fc1-46a6-a2bc-6fffef8680fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Jun 23 09:22:05.296611 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: [pid: 103986|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jun 23 09:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:22:05.489526 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG nova.api.openstack.wsgi [None req-1432cebc-81e6-49c9-a7bd-615cdcbdc6c7 admin admin] Calling method '>' {{(pid=103985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:22:05.490726 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:22:05.490726 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: warnings.warn(msg) Jun 23 09:22:05.491955 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1432cebc-81e6-49c9-a7bd-615cdcbdc6c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:22:05.492430 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1432cebc-81e6-49c9-a7bd-615cdcbdc6c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:22:05.493536 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1432cebc-81e6-49c9-a7bd-615cdcbdc6c7 admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:22:05.494188 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: DEBUG oslo_concurrency.lockutils [None req-1432cebc-81e6-49c9-a7bd-615cdcbdc6c7 admin admin] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:22:05.515697 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: INFO nova.api.openstack.requestlog [None req-1432cebc-81e6-49c9-a7bd-615cdcbdc6c7 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078094 Jun 23 09:22:05.516246 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: [pid: 103985|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jun 23 09:22:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:23:01.856868 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: Thu Jun 23 09:23:01 2022 - graceful shutdown triggered... Jun 23 09:23:01.857472 dv-cinder-847274-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 09:23:01.858364 dv-cinder-847274-1-iscsi devstack@n-api.service[103985]: Gracefully killing worker 1 (pid: 103985)... Jun 23 09:23:01.858772 dv-cinder-847274-1-iscsi devstack@n-api.service[103986]: Gracefully killing worker 2 (pid: 103986)... Jun 23 09:23:02.859467 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: worker 1 buried after 1 seconds Jun 23 09:23:02.860083 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: worker 2 buried after 1 seconds Jun 23 09:23:02.860083 dv-cinder-847274-1-iscsi devstack@n-api.service[103984]: goodbye to uWSGI. Jun 23 09:23:02.861057 dv-cinder-847274-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 09:23:02.861617 dv-cinder-847274-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 09:23:02.864508 dv-cinder-847274-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 09:23:02.876789 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 09:23:02 2022] *** Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: nodename: dv-cinder-847274-1-iscsi Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: machine: x86_64 Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: clock source: unix Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: pcre jit disabled Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: detected number of CPU cores: 4 Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: current working directory: / Jun 23 09:23:02.878778 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: detected binary path: /usr/bin/uwsgi-core Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: your processes number limit is 47680 Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: your memory page size is 4096 bytes Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: detected max file descriptor number: 2048 Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: lock engine: pthread robust mutexes Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: thunder lock: enabled Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 09:23:02.879555 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 09:23:02.924667 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: Python main interpreter initialized at 0x55c2760789c0 Jun 23 09:23:02.924667 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: python threads support enabled Jun 23 09:23:02.924667 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: your server socket listen backlog is limited to 100 connections Jun 23 09:23:02.924667 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: your mercy for graceful operations on workers is 90 seconds Jun 23 09:23:02.925151 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 09:23:02.925151 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: *** Operational MODE: preforking *** Jun 23 09:23:02.925395 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: *** uWSGI is running in multiple interpreter mode *** Jun 23 09:23:02.925395 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: spawned uWSGI master process (pid: 118480) Jun 23 09:23:02.925606 dv-cinder-847274-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 09:23:02.926305 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: spawned uWSGI worker 1 (pid: 118500, cores: 1) Jun 23 09:23:02.930975 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: spawned uWSGI worker 2 (pid: 118501, cores: 1) Jun 23 09:23:02.930975 dv-cinder-847274-1-iscsi devstack@n-api.service[118480]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 09:23:03.582932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 09:23:03.587261 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 09:23:04.809461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:23:04.809461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: from cryptography.utils import int_from_bytes Jun 23 09:23:04.810174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:23:04.810174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: from cryptography.utils import int_from_bytes Jun 23 09:23:04.858219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:23:04.858219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: from cryptography.utils import int_from_bytes Jun 23 09:23:04.862207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 09:23:04.862207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: from cryptography.utils import int_from_bytes Jun 23 09:23:07.282925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 09:23:07.283505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 09:23:07.283822 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 09:23:07.284201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 09:23:07.284485 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 09:23:07.284919 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.285281 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.285675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.286023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.286408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.286752 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.287134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.287494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.287832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.288144 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.288492 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.288852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-1-iscsi {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.289223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.289546 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.289892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.290245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.290607 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.290981 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.291339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.291877 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.292710 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.293019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.293501 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.293859 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.294207 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.294586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.294991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.295342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.295682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.296038 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.296480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-1-iscsi {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.296827 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.297168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.297498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.297978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.298384 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.299027 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.299027 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.299366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.299687 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.300055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.300428 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.300773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.301130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.301463 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.301816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.302170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.302536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.302878 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.303203 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.303514 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.303792 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.304127 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.304503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.304865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.305122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.305377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.305730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.306090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.306404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.306719 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.307064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.307378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.307694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.308007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.308319 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.308630 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.308966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.309316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.309657 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.309991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.310353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.310818 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.311094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.311471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.311781 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.312163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.312454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.312824 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.313160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.313494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.313832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.314164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.314515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.314862 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.315204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.315460 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.315793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.316133 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.316483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.316828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.317165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.317479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.317783 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.318126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.318440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.318754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.319093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.319408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.319731 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.320047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.320388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.320702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.321073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.321408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.321746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.322064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.322377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.322685 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.323279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.323598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.323964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.324305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.324627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.324941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.325277 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.325596 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.326448 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.326770 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.327107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.327475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.327829 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.328143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.328502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.328817 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.329145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.329491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.329816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.330143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.330479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.330788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.331183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.331503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.331822 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.332134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.332446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.332801 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.333150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.333515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.333904 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.334226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.334570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.334979 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.335301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.335651 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.335991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.336339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.336661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.337001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.337323 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.337693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.338018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.338358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.338683 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.339082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.339360 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.339704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.340029 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.340397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.340753 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.341095 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.342040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.342431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.342746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.343102 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.343486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.343826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.344181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.344461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.344795 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.345161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.345479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.345850 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.346194 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.346531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.346879 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.347224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.347572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.347949 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.348318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.348645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.348964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.349286 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.349606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.349948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.350287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.350606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.350953 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.351281 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.351628 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.351941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.352273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.352649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.352970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.353316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.353634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.353952 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.354273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.354608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.354976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.355605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.355944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.356257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.356591 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.357012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.357278 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.357612 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.357927 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.358267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.358617 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.358982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.359303 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.359622 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.359944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.360279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.360620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.360938 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.361329 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.361675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.362017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.362354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.362688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.363057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.363391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.363738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.364077 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.364391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.364638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 09:23:07.365090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.365188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 09:23:07.365266 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.365340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.365413 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 09:23:07.365604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.365757 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 09:23:07.365922 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.366077 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 09:23:07.366233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.366401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.366559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.366717 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.366874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.367098 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.367257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.367412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.367577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.367760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.367915 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.368071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.368218 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.368373 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.368549 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.368713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.368861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.369007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.369154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.369334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.369489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.369652 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.369807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.369962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.370118 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-1-iscsi {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.370276 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.370423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.370594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.370742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.370889 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.371069 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.371224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.371384 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.371538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.371685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.371832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.371995 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.372161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.372321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.372485 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.372976 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.373177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.373337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.373504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.373666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.373820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.373969 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.374153 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.374313 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.374490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.374661 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.374815 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.375004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.375158 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.375312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.375833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.375998 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.376146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.376301 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.376447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.376601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.376767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.376922 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-1-iscsi {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.377088 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.377243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.377398 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.377568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.377723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.377870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.378016 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.378162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.378327 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.378492 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.378657 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.378805 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.378983 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.379149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.379298 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.379458 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.379619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.379778 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.379936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.380093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.380248 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.380404 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.380559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.380712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.380867 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.381021 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.381189 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.381347 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.381494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.381641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.381788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.382023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.382175 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.382333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.382488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.382647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.382831 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.383327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.383507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.383656 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.383656 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.383936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.384090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.384237 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.384398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.384609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.384770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.384932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.385087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.385244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.385417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.385598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.386119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.386283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.386439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.386603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.386750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.386897 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.387091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.387241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.387395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.387552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.387718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.387865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.388016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.388664 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.388827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.388827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.389123 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.389270 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.389424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.389571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.389725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.389881 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.390036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.390198 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.390345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.390498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.390659 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.390807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.391015 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.391182 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.391330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.391505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.391849 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.392003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.392159 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.392306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.392471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.392630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.392859 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.393014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.393567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.393727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.393876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.394024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.394199 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.394481 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.394656 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.394815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.395002 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.395177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.395325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.395479 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.395628 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.395782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.396282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.396452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.396608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.396754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.396901 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.397047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.397192 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.397351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.397508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.397655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.397800 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.397954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.398109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.398269 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.398416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.398562 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.398726 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.398882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.399069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.399218 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.399381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.399528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.399681 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.399835 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.399990 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.400138 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.400138 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.400423 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.400568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.400714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.400874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.401028 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.401183 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.401339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.401485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.401485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.401774 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.401929 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.402084 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.402239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.402392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.402548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.402702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.402849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.403141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.403633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.403808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.404531 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.404682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.404829 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.404946 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.405047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.405131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.405212 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.405314 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.405411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.405500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.405597 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.405686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.405774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.405874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.405971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.406431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406530 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.406627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406729 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.406729 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.406898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.406898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.407400 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.407489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.407489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.407489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.407489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.407809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.407898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.407993 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.408289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.408383 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.408601 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.408895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.408990 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.409203 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.409471 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.409580 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.409849 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.410057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.410201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.411063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.411177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.411289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.411390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.411479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.411576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.411671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.411847 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.412160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.412253 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.412472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.412718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.412821 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.413083 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.413302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.413566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.413856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.413953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.414050 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.414292 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.414437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.414607 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.414954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.415063 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.415254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.415537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.415633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.415863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.416470 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 09:23:07.416582 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.416582 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.416745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.416835 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.417070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.417306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.417402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.417686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.417925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.418021 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.418293 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.418516 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.418611 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.418906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.419237 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.419572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.419882 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.419984 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.420203 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.420517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.420618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.420826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.421119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.421214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.421460 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.421709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.421821 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.422066 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.422316 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.422422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.422710 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.422938 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.423687 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.423986 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424102 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424203 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424544 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.424733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.425008 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.425111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.425318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.425627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.425728 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.425941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.426235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.426686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.426686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.426871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.426981 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.427211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.427455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.427564 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.427787 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.428053 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.428149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.428402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.428638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.428735 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.429006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.429228 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.429406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.429670 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.429856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.430064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.430385 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.430489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.430747 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.431006 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.431126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.431438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.431612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.431758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.432107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.432209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.432442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.432736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.432831 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.433065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.433334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.433438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.433731 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.434141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.434253 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.434344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.434505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.434610 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.434894 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.435638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.435753 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.436087 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.436228 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.436760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.436873 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.436973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.437063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.437320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.437436 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.437636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.437909 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.438014 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.438281 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.438517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.438625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.439190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.439305 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.439476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.439574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.439676 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.439840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.440157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.440259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.440472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.440745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.440841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.441082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.441333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.441436 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.441715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.441946 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.442053 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.442330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.442534 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.442631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.442986 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.443175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.443294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.443670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.443921 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.444292 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.444403 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.444494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.444735 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.444839 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.445046 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.445324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.445419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.445692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.445911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.446042 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.446380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.446474 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.446930 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.447068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.447220 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.447533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.447638 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.447892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.448074 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.448204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.450798 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.450969 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451164 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451744 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.451939 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452029 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452029 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452201 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.452816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.453108 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.453204 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.453440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.453703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.453805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.454090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.454449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.454570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.455300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.455398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.455497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.455587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.455675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.455763 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.456079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.456177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.456400 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457387 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457387 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.457985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.458326 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.458431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.458733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.458956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.459080 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.459411 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.459518 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.459747 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.460043 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.460145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.460368 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.460633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.460741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.460981 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.461220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.461323 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.461611 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.461820 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.461925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.462228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.462431 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.462538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.462844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.463033 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.463212 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.463526 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.463619 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.463858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.464139 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.464257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465176 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.465941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.466041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.466869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.467008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468658 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468854 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.468854 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.469027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.469124 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.469222 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.469481 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.469607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.469811 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.470184 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.470316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.470505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.470836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.470993 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.471227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.471347 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.471583 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.471684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.471936 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.472035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.472249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.472360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.472566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.472671 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.472898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473319 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473526 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473634 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473838 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.473943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.474146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.474240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.474459 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.474632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.474772 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.474879 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.475130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.475236 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.475446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.475555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.475778 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.475877 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.476096 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.476194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.476432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.476539 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.476743 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.476850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.477051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.477148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.477368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.477460 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.477687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.477793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.478006 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.478111 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.478331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.478429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.478649 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.478756 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479762 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.479978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.480076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.480545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.480664 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.480863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.480962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.481181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.481291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.481503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.481611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.481827 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.482002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.482691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.482800 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483797 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.483985 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.484127 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.484296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.484556 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.484706 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.484893 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485043 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485215 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485847 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.485992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.486158 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.486299 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.486473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.486632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.486776 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.486950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.487128 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.487280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.487442 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.487591 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.487755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.487904 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.488084 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.488220 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.488410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.488562 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.488729 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.488866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.489044 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.489182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.489368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.489505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.489682 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.489830 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490315 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490626 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.490982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.491166 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.491324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.491470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.491638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.491786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.491961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.492120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.492276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.492448 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.492613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.492782 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.492940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.493124 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.493257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.493457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.494036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.494358 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.494588 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.494759 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.495034 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.495203 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.495363 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.495511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.495658 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.495888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.496045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.496239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.496386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.496571 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.496724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.496896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.497043 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.497219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.498669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.498794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.498889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.498889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.500226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.500380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.500512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.500625 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.500770 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.500905 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501042 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501303 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501462 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501789 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.501957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502166 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502372 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502713 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.502954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503284 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503530 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503608 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.503887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.504127 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.504317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.504610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.504719 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.504942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.505262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.505376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.505579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.505893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.506205 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.506303 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.506523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.506846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.508477 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.508590 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.508680 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.508766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.508842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509405 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509405 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509590 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509682 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509771 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509859 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.509948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.510046 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.510125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.510357 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.510464 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.510672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.510780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.511016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.511133 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.513486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.513631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.513743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.513845 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.513945 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514521 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514799 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.514896 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515494 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.515956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516531 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.516854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.517122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.517240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.517452 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.517559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.517783 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.517890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.518129 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.518309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.518491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.518663 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.518803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.519063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.519213 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.519396 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.519520 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.519769 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.519868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.520075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.520182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.520395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.520569 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.520735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.520875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.521021 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.521153 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.521285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.521593 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.521748 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.521907 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.522080 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.522242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.522411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.522515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.522607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.522800 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.523107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.523257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.523412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.523880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.524053 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.524307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.524417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.524688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.524787 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.524997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.525092 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.525305 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.525419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.525622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.525721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.525937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.526042 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.526247 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.526352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.526563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.526660 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.526870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527215 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527526 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527626 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527837 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.527935 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.528148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.528301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.528462 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.528616 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.529277 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.529439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.529608 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.529711 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.529927 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.530024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.530243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.530463 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.530560 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.530720 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.530872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.537443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.537549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.537660 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.537763 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.537862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.537954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538053 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538158 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538393 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538756 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.538876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539098 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539189 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539280 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.539871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540246 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540344 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540791 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540881 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.540979 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541077 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541266 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541835 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.541933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542127 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542343 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542436 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542527 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542626 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542831 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.542950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543510 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543845 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.543937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.544034 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.544125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.544222 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.544323 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.544436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545050 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545150 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545593 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.545962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546373 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546465 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546544 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.546844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547159 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547790 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.547985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548084 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548213 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548857 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.548991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.549184 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.549285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.549497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.549596 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.549840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.549975 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.550170 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.550276 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.550487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.550585 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.550796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.550896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.551134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.551247 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.551449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.551555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.551762 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.551861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.552070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.552178 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.552511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.552609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.552829 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.552965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.553143 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.553285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.553451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.553615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.553889 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554028 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554144 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554265 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.554903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.555143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.555259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.555490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.555648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.555853 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.555972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.556148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.556249 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.556490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.556589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.556859 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.556964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.557157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.557326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.557466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.557566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.557793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.557902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.558106 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.558208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.558416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.558554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.558725 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.558963 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564253 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564601 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.564971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565161 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565432 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565530 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.565911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566102 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566200 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566387 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566759 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566851 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.566972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567371 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567569 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567661 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.567925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.568684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.568684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.568684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.568684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.568976 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.569095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.569405 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.569715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.570045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.570357 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.570674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.571068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.571384 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.571701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.572011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.572341 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.572652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.572981 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.573299 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.573628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.573956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.574334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.574668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.575005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.575318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.575644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.575959 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.576325 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.576617 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.576941 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.577277 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.577620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.577937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.578276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.578610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.578953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.579281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.579616 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.579931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.580241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.580559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.580871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.581182 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.581500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.581817 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.582128 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.582440 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.582751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.583108 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.583422 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.583752 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.584067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.584394 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.584686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.584992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.585341 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.585653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.585993 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.586321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.586652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.587011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.587330 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.587661 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.588059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.588351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.588675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.589017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.589454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.589659 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.589978 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.590296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.590612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.590953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.591292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.592352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.592687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.593008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.593327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.593646 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.593965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.594283 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.594600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.594930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.595253 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.595570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.595904 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.596234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.596564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.596903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.597228 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.597546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.597898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.598222 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.598584 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.598965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.599242 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.604451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.605112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.606999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.607836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.608231 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.608546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.608857 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.609199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.609515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.609825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.610152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.610468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.610816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.611234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.611550 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.612115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.612455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.612778 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.613112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.613452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.613769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.614083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.614414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.614727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.615064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.615385 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.615702 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.616093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.616411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.616726 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.617041 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.617356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.617672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.617980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.618309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.618623 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.618950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.619267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.619587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.619904 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.620211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.620521 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.620834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.621154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.621464 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.621780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.622171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.622490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.622828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.623191 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.623551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.623883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.624194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.624506 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.624827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.625147 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.625473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.625797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.626110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.626461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.626784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.627348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.627691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.628064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.628402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.628740 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.629052 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.629362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.629672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.629954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO dbcounter [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Registered counter for database nova_api Jun 23 09:23:07.630058 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.630302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.630618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.630950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.631271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.631587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.631906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.632223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.632538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.632853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.633168 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.633483 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.633799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.634113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.634434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.634781 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.635130 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.635455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.635777 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.636100 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.636418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.636736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.637053 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.637430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.637690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.638027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.638373 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.638683 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.639226 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.639547 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.639873 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.640197 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.640512 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.640838 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.641169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.641485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.641811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.642133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.642469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.642810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.643177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.643562 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.643821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.644135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.644441 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.644756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.645082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.646264 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.646582 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.646950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.647261 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.647585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.647906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.648224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.648542 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.648863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.649181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.649497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.649867 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.650120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.650432 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.650722 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_db.sqlalchemy.engines [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.650827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.651073 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.651383 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.651707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.652007 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.652316 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.652728 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.652964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.653307 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.653633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.654484 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.654805 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.655162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.655481 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.655811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.656141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.656466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.656783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.657119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.657435 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.657750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.657992 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writer thread running {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.658094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.658436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.658680 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.659020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.668912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.669605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.670286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.670286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.670286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.670286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 09:23:07.670286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 09:23:07.716191 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.context [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad430a24-c3fd-4ac3-a88b-78701c74d764(cell1) {{(pid=118501) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 09:23:07.720337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:23:07.721949 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:23:07.722755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:23:07.724738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:23:07.726715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO dbcounter [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Registered counter for database nova_cell0 Jun 23 09:23:07.730788 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO dbcounter [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Registered counter for database nova_api Jun 23 09:23:07.731013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO dbcounter [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Registered counter for database nova_cell1 Jun 23 09:23:07.738449 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_db.sqlalchemy.engines [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.740167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_db.sqlalchemy.engines [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.746349 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writer thread running {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.749018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writer thread running {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.751439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_db.sqlalchemy.engines [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.757881 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writer thread running {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.814207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.context [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad430a24-c3fd-4ac3-a88b-78701c74d764(cell1) {{(pid=118500) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 09:23:07.818302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:23:07.819942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:23:07.820751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:23:07.822711 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:23:07.824755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO dbcounter [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Registered counter for database nova_cell0 Jun 23 09:23:07.828776 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO dbcounter [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Registered counter for database nova_cell1 Jun 23 09:23:07.836027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_db.sqlalchemy.engines [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.837790 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_db.sqlalchemy.engines [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.843837 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writer thread running {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.845847 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writer thread running {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.901168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO dbcounter [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Registered counter for database nova_cell0 Jun 23 09:23:07.907957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_db.sqlalchemy.engines [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:07.912394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writer thread running {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:07.994038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO dbcounter [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Registered counter for database nova_cell0 Jun 23 09:23:08.003297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_db.sqlalchemy.engines [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 09:23:08.007723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writer thread running {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 09:23:08.243167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: WARNING keystonemiddleware.auth_token [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:23:08.250932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: WARNING keystonemiddleware.auth_token [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:23:08.327974 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: WARNING keystonemiddleware.auth_token [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:23:08.335292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: WARNING keystonemiddleware.auth_token [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:23:08.608415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: WARNING keystonemiddleware.auth_token [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:23:08.615055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: WARNING keystonemiddleware.auth_token [None req-7c13c2c8-8d92-4b64-a9bd-c61b1c0336aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:23:08.620717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2760789c0 pid: 118501 (default app) Jun 23 09:23:08.686361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: WARNING keystonemiddleware.auth_token [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 09:23:08.696264 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: WARNING keystonemiddleware.auth_token [None req-bd8c64f0-5fd7-42b6-8d2a-5606870fe991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 09:23:08.702437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2760789c0 pid: 118500 (default app) Jun 23 09:23:50.813972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:50.816101 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:50.817383 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:50.818472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:52.106141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-626eb7b4-c17d-4961-bbb4-45d986ae9511 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Action: 'create', calling method: .version_select at 0x7f82729e7790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-885059989", "metadata": {"Type": "work"}}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:23:54.331330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-626eb7b4-c17d-4961-bbb4-45d986ae9511 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.436150 Jun 23 09:23:54.331330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jun 23 09:23:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 09:23:54.337438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:54.337438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:54.337438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:54.337438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:54.754787 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0b08f2ca-686c-458b-ad8f-9d84574d46ec tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f8272a373a0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:55.694817 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0b08f2ca-686c-458b-ad8f-9d84574d46ec tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 200 len: 353 microversion: 2.1 time: 1.442248 Jun 23 09:23:55.695555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:23:54 2022] GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 353 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:23:55.707690 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4e7da078-af7b-44fb-bde8-d1a65cd6f48b tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f82728b15e0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:56.084336 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4e7da078-af7b-44fb-bde8-d1a65cd6f48b tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 200 len: 353 microversion: 2.1 time: 0.381214 Jun 23 09:23:56.085397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:23:55 2022] GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 353 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:23:56.099371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-720d8f77-33e0-4a0f-b57f-d381325742e9 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f82728fe790>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:56.549067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-720d8f77-33e0-4a0f-b57f-d381325742e9 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 202 len: 0 microversion: 2.1 time: 0.455497 Jun 23 09:23:56.550095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:23:56 2022] DELETE /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:23:56.558820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b6d43a11-2049-4a17-a88c-97eb6d9cb7aa tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f82728b1700>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:56.668470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b6d43a11-2049-4a17-a88c-97eb6d9cb7aa tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 200 len: 352 microversion: 2.1 time: 0.114116 Jun 23 09:23:56.674458 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:23:56 2022] GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:23:57.688050 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4976176f-20ca-4454-a3b4-9962abb23347 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f82728fe3a0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:57.761134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4976176f-20ca-4454-a3b4-9962abb23347 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 200 len: 352 microversion: 2.1 time: 0.079033 Jun 23 09:23:57.761941 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:23:57 2022] GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:23:58.774353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0dc62e06-d794-497f-b34e-0c597c0870f7 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f82728b1d30>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:58.846717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0dc62e06-d794-497f-b34e-0c597c0870f7 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 200 len: 352 microversion: 2.1 time: 0.076323 Jun 23 09:23:58.848209 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:23:58 2022] GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:23:59.862774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4920fa27-f559-46de-a306-227ae47e5855 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Calling method '.version_select at 0x7f82728ae310>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:23:59.925346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-4920fa27-f559-46de-a306-227ae47e5855 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] HTTP exception thrown: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4920fa27-f559-46de-a306-227ae47e5855 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Request method failure captured: Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 HTTP/1.1 Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDEmCJngpt-w6h3GNX12XKxK6fK0M2ooTcPqEQ3hduUcGlsz6Fdi4SnamgwoZ96t29kcVVPgYQQpj1_g9pR6Qzyq-sNhUSl4ExEJMCUAJdU_uD8E1A3X2Hw0S-1frxRiMP3w20OkKHj3Pt1PjFOko1bJ47v65CFB4ZI6NEYWJcWfzOM Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: ad2e6e427876444390f75d4cc8080347 Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesGetTestJSON-1807820631 Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:23:59.940246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad2e6e427876444390f75d4cc8080347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad2e6e427876444390f75d4cc8080347"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad2e6e427876444390f75d4cc8080347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad2e6e427876444390f75d4cc8080347", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesGetTestJSON-1807820631 Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: ad2e6e427876444390f75d4cc8080347 Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesGetTestJSON-1807820631 Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesGetTestJSON-1807820631-project Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 4570d1fead8c4328a99cd58a02867c45 Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesGetTestJSON-1807820631-project Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'ed1abb67-165b-4a31-8605-bfb6173b4fc5'} Jun 23 09:23:59.948240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. (HTTP 404) (Request-ID: req-9994cdd9-c81d-4c9f-a643-847794879dda) Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:23:59.949179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:23:59.951669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 09:23:59.952676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4920fa27-f559-46de-a306-227ae47e5855 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] Returning 404 to user: Volume ed1abb67-165b-4a31-8605-bfb6173b4fc5 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4920fa27-f559-46de-a306-227ae47e5855 tempest-VolumesGetTestJSON-1807820631 tempest-VolumesGetTestJSON-1807820631-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5" status: 404 len: 109 microversion: 2.1 time: 0.086668 Jun 23 09:23:59.956194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:23:59 2022] GET /compute/v2.1/os-volumes/ed1abb67-165b-4a31-8605-bfb6173b4fc5 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:24:01.750799 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-418e456a-c120-4766-a39c-d7d654837667 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'create', calling method: .version_select at 0x7f82728c7310>, body: {"keypair": {"name": "tempest-keypair-2049242089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIR4UUvbyu38DfiX7XryD9YJDYAwnzkkbMpZE637V6E3NMoL7A1s2L4BkmN2VlNRyIerPIYnFOQTAIQ5XnHSktD0asHsT5/r3rthxjTq0o0FeHkw1OWUMiw+GUD6BJejw=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:01.877029 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-418e456a-c120-4766-a39c-d7d654837667 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for project 29ece34041e04c78868e53d90b658a82. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:24:01.898959 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-418e456a-c120-4766-a39c-d7d654837667 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for user 30bc3dba44ed4d14a67e56aa640bf9ca and project 29ece34041e04c78868e53d90b658a82. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:24:02.131643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-418e456a-c120-4766-a39c-d7d654837667 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.699492 Jun 23 09:24:02.131643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 5/9] 10.222.0.52 () {62 vars in 1199 bytes} [Thu Jun 23 09:24:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 722 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 09:24:04.992825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-443276720", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:05.239483 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] validate_networks() for [('f9023da2-9c4b-4934-b1b2-3b253a92c58b', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:24:05.710650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1487875241", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "networks": [{"uuid": "d2c6a2f1-6342-4920-800e-25b59a18fe42"}]}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:05.832093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] validate_networks() for [('d2c6a2f1-6342-4920-800e-25b59a18fe42', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:24:06.316349 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:24:06.317314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:24:06.317840 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:24:06.318258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:24:06.318671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:24:06.343456 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:06.343916 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:06.344931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:06.345523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:06.408176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:24:06.421105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for user 29fe5fb181e2452388d24fd0b7aa5e9f and project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:24:06.439409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:24:06.442398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:24:06.658525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-af620d7e-6b5b-463e-a554-847696e76e73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.935191 Jun 23 09:24:06.664920 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 5/10] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:24:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:24:06.673027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-75cd9f4a-1a7b-4b7b-8300-2cb7a74b445e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:06.674097 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-75cd9f4a-1a7b-4b7b-8300-2cb7a74b445e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:06.810109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-75cd9f4a-1a7b-4b7b-8300-2cb7a74b445e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:06.825943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-75cd9f4a-1a7b-4b7b-8300-2cb7a74b445e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1221 microversion: 2.1 time: 0.157817 Jun 23 09:24:06.843979 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:06 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:06.999514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1092008183", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:07.069445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] validate_networks() for [('f9023da2-9c4b-4934-b1b2-3b253a92c58b', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:24:07.206688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:24:07.207304 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:24:07.207942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:24:07.208714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:24:07.209140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:24:07.224095 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:07.226297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:07.226297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:07.227161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:07.266276 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Getting quotas for project 0160aecb23854482b26d188beec1021d. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:24:07.275972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Getting quotas for user 6e7f2d909d45471fb0b97ddb724cb195 and project 0160aecb23854482b26d188beec1021d. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:24:07.302093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:24:07.305753 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:24:07.463875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-79d3e8a3-bb8e-4cb9-88f2-3c3d60f2d770 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050627 Jun 23 09:24:07.464550 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 6/12] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 09:24:07.479762 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1430068207", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "730dea22-6746-4fe9-87f5-32cb3807b5fd"}], "security_groups": [{"name": "tempest-securitygroup--295018775"}], "key_name": "tempest-keypair-2049242089", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:07.664336 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:24:07.669506 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:24:07.671041 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:24:07.672005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:24:07.672651 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:24:07.692695 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:07.693159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:07.693968 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:07.696304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:07.753052 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:24:07.769121 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for user 29fe5fb181e2452388d24fd0b7aa5e9f and project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:24:07.822363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:24:07.826664 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:24:07.838048 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] validate_networks() for [('730dea22-6746-4fe9-87f5-32cb3807b5fd', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:24:08.055101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e8aa5d3e-79bf-4a22-8c9f-22001c8c15f6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.057901 Jun 23 09:24:08.055981 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 7/13] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:24:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:24:08.061732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a3b52796-c9d4-4166-9b36-9c97d7ae2e9f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:08.062887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a3b52796-c9d4-4166-9b36-9c97d7ae2e9f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:08.161960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a3b52796-c9d4-4166-9b36-9c97d7ae2e9f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:08.171441 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a3b52796-c9d4-4166-9b36-9c97d7ae2e9f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1215 microversion: 2.1 time: 0.114032 Jun 23 09:24:08.172025 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 8/14] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:08 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:08.177345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b0fe240c-c334-47a6-aa34-d2a4d35c7815 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:08.178519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b0fe240c-c334-47a6-aa34-d2a4d35c7815 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:08.288505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b0fe240c-c334-47a6-aa34-d2a4d35c7815 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:08.296091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b0fe240c-c334-47a6-aa34-d2a4d35c7815 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1222 microversion: 2.1 time: 0.122880 Jun 23 09:24:08.303042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 9/15] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:08 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:08.716713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:24:08.718337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:24:08.719245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:24:08.719808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:24:08.720372 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:24:08.733238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:08.733866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:08.735093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:08.736412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:08.757482 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for project 29ece34041e04c78868e53d90b658a82. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:24:08.763235 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for user 30bc3dba44ed4d14a67e56aa640bf9ca and project 29ece34041e04c78868e53d90b658a82. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:24:08.776698 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:24:08.779358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:24:09.041052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-500f4a2c-18ad-4571-8751-7c1767a38047 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.568334 Jun 23 09:24:09.044165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 7/16] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Jun 23 09:24:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 09:24:09.052631 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f0320313-f30f-4a21-9ee3-bd5c257ceb71 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:09.053491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f0320313-f30f-4a21-9ee3-bd5c257ceb71 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:09.191937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-18fbb2ef-6f27-40d2-8d80-22828dd003cc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:09.192694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-18fbb2ef-6f27-40d2-8d80-22828dd003cc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:09.238139 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f0320313-f30f-4a21-9ee3-bd5c257ceb71 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:09.257281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f0320313-f30f-4a21-9ee3-bd5c257ceb71 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:09.264732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f0320313-f30f-4a21-9ee3-bd5c257ceb71 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:09.269408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f0320313-f30f-4a21-9ee3-bd5c257ceb71 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1282 microversion: 2.20 time: 0.219996 Jun 23 09:24:09.271297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 10/17] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:09 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:09.320725 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-aa908636-86f7-442b-b348-1d1ffeac5307 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:09.321360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-aa908636-86f7-442b-b348-1d1ffeac5307 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:09.429050 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-aa908636-86f7-442b-b348-1d1ffeac5307 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:09.436311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-18fbb2ef-6f27-40d2-8d80-22828dd003cc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:09.437364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-aa908636-86f7-442b-b348-1d1ffeac5307 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1222 microversion: 2.1 time: 0.125641 Jun 23 09:24:09.437953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 11/18] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:09 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:09.457655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-18fbb2ef-6f27-40d2-8d80-22828dd003cc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1215 microversion: 2.1 time: 0.271852 Jun 23 09:24:09.458954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 8/19] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:09 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:10.288982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0e667e99-1fe4-40ee-a5c2-9b06afc67234 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:10.289621 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0e667e99-1fe4-40ee-a5c2-9b06afc67234 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:10.352579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0e667e99-1fe4-40ee-a5c2-9b06afc67234 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:10.368469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0e667e99-1fe4-40ee-a5c2-9b06afc67234 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:10.371376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0e667e99-1fe4-40ee-a5c2-9b06afc67234 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:10.373370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0e667e99-1fe4-40ee-a5c2-9b06afc67234 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1282 microversion: 2.20 time: 0.089228 Jun 23 09:24:10.385602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 12/20] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:10 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:10.454269 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:10.455891 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:10.469731 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:10.470313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:10.475880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:10.478720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:10.478837 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:10.478944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:10.486627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:10.489267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:10.490259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:10.492489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:10.797548 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:10.825896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e7107cc3-c6fc-4642-8baf-52f094f6a564 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1226 microversion: 2.1 time: 0.375424 Jun 23 09:24:10.827532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 9/21] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:10 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1226 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:10.892816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:10.916873 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e676b640-b901-46b0-b067-4dae25ac4962 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1219 microversion: 2.1 time: 0.442654 Jun 23 09:24:10.916873 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 13/22] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:10 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1219 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:11.393950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:11.394570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:11.401705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:11.402078 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:11.402850 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:11.404050 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:11.519258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:11.519997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b0dfb444-7289-447e-a3e7-92039aab8912 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f827165f5e0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:11.526099 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:11.527695 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:11.529375 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-636a2941-6ff3-461e-8b41-4febfce04aba tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1278 microversion: 2.20 time: 0.139952 Jun 23 09:24:11.540140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 10/23] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:11 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:11.849798 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:11.850745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:11.852538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b0dfb444-7289-447e-a3e7-92039aab8912 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1c3d8adb-6526-4930-9b66-db78630b96f4" status: 200 len: 350 microversion: 2.1 time: 0.343022 Jun 23 09:24:11.853390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 14/24] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:24:11 2022] GET /compute/v2.1/os-volumes/1c3d8adb-6526-4930-9b66-db78630b96f4 => generated 350 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:24:11.868125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:11.868841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:11.869905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:11.870521 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:11.931937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:11.932795 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:11.947475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:11.952739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:11.952739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:11.952739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:11.963471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:11.972569 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-54fb0788-1303-4c05-b000-e22f672ae9be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1274 microversion: 2.1 time: 0.130273 Jun 23 09:24:11.973139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 11/25] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:11 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:12.025375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:12.033996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-df69489f-e644-4a7a-87da-cb43763d8357 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1275 microversion: 2.1 time: 0.105737 Jun 23 09:24:12.035140 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 15/26] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:11 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:12.562464 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:12.567298 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:12.584754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:12.585303 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:12.586112 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:12.586561 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:12.787762 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:12.798361 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:12.811957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:12.814282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-214d643a-e6b6-4cb5-ba3d-b7871237ba2f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1278 microversion: 2.20 time: 0.269306 Jun 23 09:24:12.824711 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 12/27] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:12 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:12.989918 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:12.990536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:13.002090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:13.002556 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:13.003374 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:13.003844 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:13.051769 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:13.052549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:13.059132 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:13.060161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:13.060933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:13.061371 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:13.072667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:13.081847 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e7465926-426d-48cc-bbc2-3f2770be1a9d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1282 microversion: 2.1 time: 0.095831 Jun 23 09:24:13.082355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:12 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:13.192070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:13.208568 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-59e13697-da75-4093-9a88-614e1d49cca4 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1273 microversion: 2.1 time: 0.152682 Jun 23 09:24:13.215617 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 13/29] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:13 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:13.849931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:13.850785 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:13.872274 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:13.880716 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:13.886701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:13.889333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:14.036256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:14.046060 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:14.047828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:14.049071 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-27dcd00d-82f2-4740-8be2-a66fc6e66a20 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1352 microversion: 2.20 time: 0.219670 Jun 23 09:24:14.059093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 17/30] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:13 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1352 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:14.107673 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:14.107673 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:14.124317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:14.124773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:14.125618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:14.126113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:14.225746 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:14.226971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:14.240297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:14.242595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:14.244630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:14.245618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:14.339059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:14.345888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-bf6e5abc-eb05-4170-b569-10e509558003 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1273 microversion: 2.1 time: 0.125869 Jun 23 09:24:14.347244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 18/31] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:14 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:14.444513 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:14.461359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e4ef4639-b252-4498-8903-5b4f1bd2e14d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1280 microversion: 2.1 time: 0.360942 Jun 23 09:24:14.463064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 14/32] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:14 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:14.864195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1ccfae8f-0150-4c33-b5d4-59176e4c001c tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f827161f0d0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:15.006499 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1ccfae8f-0150-4c33-b5d4-59176e4c001c tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/78bdb5ac-11d0-4d3a-81ba-c4cdc031d2b3" status: 200 len: 351 microversion: 2.1 time: 0.146027 Jun 23 09:24:15.009324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 19/33] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:24:14 2022] GET /compute/v2.1/os-volumes/78bdb5ac-11d0-4d3a-81ba-c4cdc031d2b3 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:15.075353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:15.075977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:15.082004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:15.082744 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:15.083736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:15.084393 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:15.210238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:15.218341 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:15.220122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:15.221237 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-54bac574-b492-4adb-9d21-87b8fa330d8d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1340 microversion: 2.20 time: 0.151041 Jun 23 09:24:15.232798 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 15/34] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:15 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:15.365694 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:15.366339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:15.374565 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:15.375044 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:15.376025 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:15.376667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:15.487201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:15.488189 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:15.499165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:15.500263 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:15.502305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:15.502757 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:15.589780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:15.598133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cf1bd1e3-461c-4827-b960-89e3ec0a6252 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.238255 Jun 23 09:24:15.598888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 20/35] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:15 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:15.727536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:15.768225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6e449d7a-5354-440a-a834-04df37bf17db tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.286155 Jun 23 09:24:15.769592 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 16/36] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:15 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:16.239911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:16.240524 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:16.246644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:16.247293 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:16.248060 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:16.248501 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:16.376074 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:16.383968 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:16.385520 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:16.386615 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0ade7718-06db-4fd4-9674-bb801416b9e0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.150564 Jun 23 09:24:16.387215 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 21/37] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:16 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:24:16.615905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:16.616605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:16.622650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:16.623154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:16.623923 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:16.624364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:16.787205 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:16.787840 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:16.796747 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:16.802300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:16.803100 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:16.804509 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:16.805836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:16.807634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-be655bff-9367-423d-afcd-07d42fde33e5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.195562 Jun 23 09:24:16.817469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 17/38] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:16 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:16.987791 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:16.999997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8aee7a28-5792-4a06-861b-f9a9cd58482e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.217661 Jun 23 09:24:17.001815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 22/39] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:16 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:17.406606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:17.407489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:17.419341 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:17.425913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:17.425913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:17.425913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:17.580062 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:17.590400 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:17.592045 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:17.593159 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-73324f63-82e5-423a-b0f6-3244a7dbca6b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.192533 Jun 23 09:24:17.593724 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 18/40] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:17 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:17.830678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:17.833505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:17.837430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:17.848091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:17.848091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:17.848091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:17.848091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:18.026665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:18.029905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:18.038968 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:18.040310 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:18.041403 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:18.042439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:18.099329 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:18.111113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cb2e3d2a-ab64-449a-b92c-2840ab1e7add tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.287031 Jun 23 09:24:18.115481 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 23/41] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:17 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:18.130855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-996306b6-d216-4150-882d-496b5a08abce tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f82716e35e0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:18.242125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-996306b6-d216-4150-882d-496b5a08abce tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e8eebc06-0f5c-447c-9bee-119c7a665bdf" status: 200 len: 350 microversion: 2.1 time: 0.125408 Jun 23 09:24:18.242819 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 24/42] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:24:18 2022] GET /compute/v2.1/os-volumes/e8eebc06-0f5c-447c-9bee-119c7a665bdf => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:18.256516 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3f18d88b-47f4-4f18-b532-1c95b038f279 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f827161fee0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:18.607728 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3f18d88b-47f4-4f18-b532-1c95b038f279 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.352813 Jun 23 09:24:18.617332 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 25/43] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Jun 23 09:24:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:18.627850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:18.628576 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:18.657890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:18.658411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:18.662049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:18.663371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:18.748215 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=4 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:18.891562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:18.900278 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cab04a7f-8c4f-48d8-9a06-e1c2f69850d1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.879436 Jun 23 09:24:18.908536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 19/44] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:18 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:18.917922 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-67d6c474-4b89-44ac-84c3-41bfdd92a101 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f8270eae5e0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.043298 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:19.061111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:19.064163 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:19.068911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f13f536b-de72-472e-8e16-0627057ada4a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.445696 Jun 23 09:24:19.073619 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 26/45] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:18 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:19.136510 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.137243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:19.144515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:19.149185 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:19.151112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:19.154325 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:19.277026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-67d6c474-4b89-44ac-84c3-41bfdd92a101 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.371029 Jun 23 09:24:19.277698 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 20/46] 10.222.0.52 () {58 vars in 1148 bytes} [Thu Jun 23 09:24:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:19.290134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7c4f7bd4-ff02-4563-b25d-84e1fda7eb6a tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f8270e06820>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.413908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7c4f7bd4-ff02-4563-b25d-84e1fda7eb6a tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.127792 Jun 23 09:24:19.414560 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:19.427034 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cb2a25c9-5320-49c8-bc44-cc7a7de8c1f4 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f8270ea3790>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.453836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=18 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:19.560673 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cb2a25c9-5320-49c8-bc44-cc7a7de8c1f4 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.137403 Jun 23 09:24:19.561256 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 22/48] 10.222.0.52 () {58 vars in 1166 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:19.573443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8d7f7846-a3ca-4df9-9f32-ccbdc1b89962 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f8273214940>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.665172 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8d7f7846-a3ca-4df9-9f32-ccbdc1b89962 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095535 Jun 23 09:24:19.673296 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 23/49] 10.222.0.52 () {58 vars in 1169 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:24:19.678863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9c4a8fa4-f3e0-49a6-8871-df785fddb2fc tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f8270eae160>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.894798 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9c4a8fa4-f3e0-49a6-8871-df785fddb2fc tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.218008 Jun 23 09:24:19.896342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 24/50] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:19.922103 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c0a706e2-d399-47ce-bfed-fc98dc273b2b tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f8270e06310>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:19.959883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:19.987495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d20e29f7-8631-4563-aa37-ed9f3a05d938 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.842915 Jun 23 09:24:19.997070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 27/51] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:20.012119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:20.013276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:20.036437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:20.039238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:20.042991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:20.045626 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:20.196394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c0a706e2-d399-47ce-bfed-fc98dc273b2b tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.283946 Jun 23 09:24:20.196706 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 25/52] 10.222.0.52 () {58 vars in 1187 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:20.207814 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:20.209977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:20.231499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:20.231499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:20.233010 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:20.233705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:20.356255 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=24 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:20.449914 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:20.467055 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b0aff497-b2fe-43bc-af03-d47ed7173b82 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.477742 Jun 23 09:24:20.472175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 28/53] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:19 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:20.472584 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-52b894f6-93a2-4fd7-80ac-5a87457fead6 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] Calling method '.version_select at 0x7f827163c310>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:20.638424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:20.652988 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:20.663861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:20.664283 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-52b894f6-93a2-4fd7-80ac-5a87457fead6 tempest-VolumesTestJSON-43292036 tempest-VolumesTestJSON-43292036-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.195145 Jun 23 09:24:20.664858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 29/54] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Jun 23 09:24:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:20.690847 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-df2d234b-caf5-48cd-abd4-dd58f62d9376 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.491974 Jun 23 09:24:20.692049 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 26/55] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:20 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:21.005142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:21.005756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:21.027315 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:21.027906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:21.035531 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:21.036536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:21.485527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:21.486433 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:21.511872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:21.511872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:21.511872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:21.518002 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:21.951996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:21.963987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6c5cfeca-0af8-42c3-8b86-67eda31f23c8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.962579 Jun 23 09:24:21.968240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 30/56] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:20 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:22.069686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-983c1ce4-43e4-4888-a7e7-caef62456b2d req-d52c2b9b-bd71-4530-a1ec-b967af7f8acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead81496-995d-41ce-8a52-0c61545053f7", "tag": "3ed4c870-26d7-4fa7-9842-6dc0b9ff1906"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:22.083830 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:22.089455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-983c1ce4-43e4-4888-a7e7-caef62456b2d req-d52c2b9b-bd71-4530-a1ec-b967af7f8acb service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:22.090109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-983c1ce4-43e4-4888-a7e7-caef62456b2d req-d52c2b9b-bd71-4530-a1ec-b967af7f8acb service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:22.095345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-605950c7-cf73-45e4-9136-b139dea878ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.612844 Jun 23 09:24:22.108206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 27/57] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:21 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:22.114055 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-983c1ce4-43e4-4888-a7e7-caef62456b2d req-d52c2b9b-bd71-4530-a1ec-b967af7f8acb service nova] Creating event network-changed:3ed4c870-26d7-4fa7-9842-6dc0b9ff1906 for instance ead81496-995d-41ce-8a52-0c61545053f7 on hv-cinder-84727 Jun 23 09:24:22.114799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-983c1ce4-43e4-4888-a7e7-caef62456b2d req-d52c2b9b-bd71-4530-a1ec-b967af7f8acb service nova] Acquired lock "compute-rpcapi-router" {{(pid=118500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 09:24:22.116071 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:22.116659 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:22.117589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:22.118193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:22.119658 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:22.121998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:22.130734 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.compute.rpcapi [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 09:24:22.135389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] Releasing lock "compute-rpcapi-router" {{(pid=118500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 09:24:22.139485 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:22.141051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:22.143260 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:22.143260 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:22.186564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-94fdd41c-3ea9-4327-8f20-8d667daef621 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216292 Jun 23 09:24:22.188818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 31/58] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:22.268632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-a09ce42b-21b9-4f2c-b27e-94ac72fff550 req-5bb8b6bd-2fe3-4b3d-9e27-005dd2b532aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:22.277187 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-a09ce42b-21b9-4f2c-b27e-94ac72fff550 req-5bb8b6bd-2fe3-4b3d-9e27-005dd2b532aa service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:22.277640 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-a09ce42b-21b9-4f2c-b27e-94ac72fff550 req-5bb8b6bd-2fe3-4b3d-9e27-005dd2b532aa service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:22.298389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-a09ce42b-21b9-4f2c-b27e-94ac72fff550 req-5bb8b6bd-2fe3-4b3d-9e27-005dd2b532aa service nova] Creating event network-changed:a29b275b-5e50-40ac-a543-defb30d49ca9 for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b on hv-cinder-84727 Jun 23 09:24:22.303855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-a09ce42b-21b9-4f2c-b27e-94ac72fff550 req-5bb8b6bd-2fe3-4b3d-9e27-005dd2b532aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113479 Jun 23 09:24:22.304816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 32/59] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:22.393821 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:22.402164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:22.404570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:22.407874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7a1de1da-90e2-4a60-934f-f38ba97b5516 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.296401 Jun 23 09:24:22.424334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 28/60] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:22 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:22.984460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:22.986670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:22.994196 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:23.008799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:23.008799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:23.008799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:23.113623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:23.114457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:23.121496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:23.127302 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:23.130110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:23.131435 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:23.172610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:23.189379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-626ac8f5-a2b3-4bf5-b6a4-c4d35540af5c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.198900 Jun 23 09:24:23.189379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 33/61] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:22 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:23.320998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:23.328550 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b4cd4523-0952-4aaa-b6fb-fb27e894649c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.218923 Jun 23 09:24:23.329114 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 29/62] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:23 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:23.429030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:23.434869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:23.436891 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:23.437334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:23.438080 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:23.438507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:23.603754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:23.607545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:23.612428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:23.613919 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:23.615023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c59f0e19-accb-49e4-89c6-fac9743f9621 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.191925 Jun 23 09:24:23.615574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 34/63] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:23 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:24.197051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:24.197902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:24.207973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-3a1515f3-01f4-46f3-aa16-0a489ac00858 req-fcecd88c-0f66-4174-8041-fb032b874110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3d67ef-4a97-4375-951b-a9b4913c9328", "tag": "b14d8f63-9bec-4c93-a616-82eccf48fea9"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:24.213320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.213851 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.214704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.215240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.216147 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-3a1515f3-01f4-46f3-aa16-0a489ac00858 req-fcecd88c-0f66-4174-8041-fb032b874110 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.216585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-3a1515f3-01f4-46f3-aa16-0a489ac00858 req-fcecd88c-0f66-4174-8041-fb032b874110 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.227344 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-3a1515f3-01f4-46f3-aa16-0a489ac00858 req-fcecd88c-0f66-4174-8041-fb032b874110 service nova] Creating event network-changed:b14d8f63-9bec-4c93-a616-82eccf48fea9 for instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 on hv-cinder-84727 Jun 23 09:24:24.232671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-3a1515f3-01f4-46f3-aa16-0a489ac00858 req-fcecd88c-0f66-4174-8041-fb032b874110 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028008 Jun 23 09:24:24.233268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 35/64] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:24:24.328534 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-1028ffda-70b4-4f12-b5d5-f5bb9ade01cc req-c6d55640-ed61-4b75-ad47-8612d9469c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4921354-594f-4b15-b3f2-47a3d838f851", "tag": "4945a4dc-aecf-48ce-bab1-065123f856ba"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:24.345554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-1028ffda-70b4-4f12-b5d5-f5bb9ade01cc req-c6d55640-ed61-4b75-ad47-8612d9469c0b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.346000 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-1028ffda-70b4-4f12-b5d5-f5bb9ade01cc req-c6d55640-ed61-4b75-ad47-8612d9469c0b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.355674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:24.358340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-1028ffda-70b4-4f12-b5d5-f5bb9ade01cc req-c6d55640-ed61-4b75-ad47-8612d9469c0b service nova] Creating event network-changed:4945a4dc-aecf-48ce-bab1-065123f856ba for instance d4921354-594f-4b15-b3f2-47a3d838f851 on hv-cinder-84727 Jun 23 09:24:24.362081 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=100 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:24.363075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-1028ffda-70b4-4f12-b5d5-f5bb9ade01cc req-c6d55640-ed61-4b75-ad47-8612d9469c0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039174 Jun 23 09:24:24.363663 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 36/65] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:24.366652 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-31bba5cf-844f-4afa-8f26-c50d1bcbc5d8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.173513 Jun 23 09:24:24.367443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 30/66] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:24 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:24.368865 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:24.369559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:24.375821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.376321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.377084 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.377526 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.505813 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:24.513186 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7a6d8401-80e2-4933-8e60-1a7712f74c19 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.148254 Jun 23 09:24:24.513750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 37/67] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:24 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:24.633037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:24.633756 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:24.645728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.646870 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.648331 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:24.649376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:24.810409 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:24.819498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:24.822041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:24.823279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-33d5a12d-eeed-4cf6-b8d4-f9489c180db7 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.194243 Jun 23 09:24:24.823877 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 31/68] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:24 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:25.384244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:25.385091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:25.392047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:25.392669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:25.393311 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:25.393899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:25.532692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:25.533945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:25.546168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:25.546933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:25.548096 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:25.548745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:25.578868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:25.587337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c7c7945e-0a65-4982-b3cf-6847e957054a tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.207384 Jun 23 09:24:25.592251 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 38/69] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:25 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:25.725656 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:25.733525 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-478cc883-6f1e-483e-9b5a-6f6076efe1be tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.206296 Jun 23 09:24:25.734265 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 32/70] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:25 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:25.841796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:25.842407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:25.845436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:25.848924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:25.849369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:25.850123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:25.850561 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:25.990876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:26.013843 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:26.016008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:26.030812 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1c5ae97c-0415-4221-b4fa-eaf8e5d9926b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.179266 Jun 23 09:24:26.030812 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 39/71] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:25 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:26.610813 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:26.611465 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:26.623167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:26.623910 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:26.624847 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:26.625430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:26.756678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:26.757303 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:26.768583 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:26.769278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:26.770359 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:26.771180 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:26.808833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:26.838549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-98d0e764-6c61-490e-8cb7-a05abe5e6572 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.228735 Jun 23 09:24:26.844074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 33/72] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:26 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:26.971799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:26.983811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c447d86b-57ef-4642-b31e-964f44919efd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.229710 Jun 23 09:24:26.983811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 40/73] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:26 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:27.039980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:27.040629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:27.050593 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:27.051372 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:27.052331 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:27.052928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:27.220026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:27.236136 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:27.237852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:27.239508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ab15f79e-8c49-4d72-8eb9-77e038f3b296 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.204919 Jun 23 09:24:27.243242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 34/74] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:27 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:27.864309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:27.869657 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:27.872290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:27.872924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:27.873851 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:27.874423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:28.000810 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:28.002266 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:28.009309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:28.009939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:28.011820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:28.012469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:28.062877 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:28.074270 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c436a8e0-447d-4c47-a6a1-8428c556f0bc tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.218915 Jun 23 09:24:28.085147 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 41/75] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:27 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:28.235883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:28.244302 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-210c14b5-92d8-4f74-9c2b-abf8ff6c7d07 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.250218 Jun 23 09:24:28.245097 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 35/76] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:27 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:28.264332 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:28.265357 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:28.272305 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:28.272870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:28.273876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:28.274503 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:28.450853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:28.459013 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:28.460514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:28.461650 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-31285384-a846-48c9-b04f-bf516ecbc0ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.202056 Jun 23 09:24:28.462154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 42/77] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:28 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:29.092491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:29.093312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:29.100273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:29.100794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:29.101644 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:29.102196 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:29.237408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:29.244868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-06d13f40-8eba-460e-9bb4-330e39d8e203 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.156269 Jun 23 09:24:29.245430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 36/78] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:29 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:29.265715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:29.265715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:29.268708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:29.269225 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:29.270091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:29.270544 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:29.413867 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:29.421871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f7d208ee-17b5-4bdb-b67a-7beb0aed3e97 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.164273 Jun 23 09:24:29.422426 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 43/79] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:29 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:29.479544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:29.480154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:29.487098 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:29.487545 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:29.488300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:29.488736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:29.625909 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:29.633923 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:29.637751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:29.637751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-954805f5-4b28-4578-a782-5b5824e3915a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.160870 Jun 23 09:24:29.637751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 37/80] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:29 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:30.262312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:30.263642 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:30.269707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:30.270291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:30.270953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:30.271380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:30.403473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:30.410824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ee2b0c34-2bfa-4244-b77d-35c4f4944a7f tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.152423 Jun 23 09:24:30.411438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 44/81] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:30 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:30.438567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:30.439215 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:30.445677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:30.446121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:30.446884 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:30.447400 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:30.616274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:30.623905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b1027945-82cf-4e7e-af81-b3c7ba581576 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.188914 Jun 23 09:24:30.624483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 38/82] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:30 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:30.654142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:30.654750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:30.660672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:30.661105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:30.661895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:30.662329 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:30.925746 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:30.933606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:30.935149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:30.936240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1bf0dd02-2bf9-425a-b4d7-bc180ee1fee3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.286670 Jun 23 09:24:30.936793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 45/83] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:30 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:31.428219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:31.428888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:31.430752 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:31.435977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:31.436416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:31.437165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:31.437596 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:31.560940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:31.568534 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-69118171-f720-4cc3-9e78-c4eaf3e140df tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.144080 Jun 23 09:24:31.569109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 39/84] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:31 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:31.640928 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:31.641533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:31.647627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:31.648074 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:31.648828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:31.649268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:31.775517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:31.782872 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-998eff76-f21e-4ce0-a1d9-11f980ded4ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.146268 Jun 23 09:24:31.783463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 46/85] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:31 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:31.954374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:31.954896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:31.960808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:31.961286 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:31.962002 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:31.962432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:32.125482 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:32.133399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:32.135311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:32.136275 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6c2e5431-76a2-4305-b6d7-73885a7e0b65 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.186483 Jun 23 09:24:32.137720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 40/86] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:31 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:32.585629 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:32.586455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:32.595165 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:32.597109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:32.597730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:32.598702 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:32.599565 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:32.799524 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:32.800138 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:32.808233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:32.814455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:32.814455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:32.814455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:33.047615 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:33.057090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a496a0bb-8e6c-400b-906d-f1a25efbbae1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.475312 Jun 23 09:24:33.057668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 47/87] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:32 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:33.154763 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:33.155698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:33.166695 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:33.173154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:33.173154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:33.173154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:33.309832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:33.319423 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-71e1326a-246a-44bf-b7aa-c230bff0fd7f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.523537 Jun 23 09:24:33.320467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 41/88] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:32 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:33.515304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:33.532578 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:33.535369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:33.536528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f7fbe8db-54ec-4cba-ae94-eee297563812 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.386784 Jun 23 09:24:33.538937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 48/89] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:33 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:34.075425 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:34.076077 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:34.082313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:34.082754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:34.083534 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:34.083967 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:34.214866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:34.222961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fea94ea2-720f-441a-a524-48af0745e9b5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.152201 Jun 23 09:24:34.223532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 42/90] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:34 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:34.337089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:34.337703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:34.345075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:34.345528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:34.346302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:34.346741 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:34.512177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:34.516070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-61aa12a9-8fa6-47dd-b767-7079dfa8ed89 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.183699 Jun 23 09:24:34.516655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 49/91] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:34 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:34.557015 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:34.557970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:34.567915 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:34.568667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:34.569994 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:34.570675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:34.739642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:34.748707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:34.750549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:34.751728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-01027ecf-5102-4973-b560-b9e3d53f53c0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.198857 Jun 23 09:24:34.752287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 43/92] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:34 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:35.239624 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:35.240170 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:35.246201 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:35.247159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:35.247930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:35.248368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:35.544071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:35.544854 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:35.569001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:35.569445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:35.570221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:35.570653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:36.083937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:36.096548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-52912786-3c69-411f-8a08-24134b525da2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.860658 Jun 23 09:24:36.108037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 50/93] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:35 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:36.109496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:36.110407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:36.118270 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:36.124264 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:36.125897 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:36.127027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:36.160750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:36.174878 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f55422a9-7978-4d22-bee8-d0f8144a9f0a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.643974 Jun 23 09:24:36.189074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 44/94] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:35 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:36.586824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:36.595300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:36.596904 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:36.598087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-abff0d2b-a43b-45ef-a1cb-d7d9585ad134 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.494037 Jun 23 09:24:36.598839 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 51/95] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:36 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:37.125340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:37.125340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:37.128512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:37.128958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:37.129725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:37.130156 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:37.192535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:37.193154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:37.200053 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:37.205368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:37.205368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:37.205368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:37.326703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:37.331678 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1fadfd8f-267f-481b-8f28-e42e4cc64ff0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.218141 Jun 23 09:24:37.353424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 45/96] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:37 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:37.442831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:37.446483 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:37.451042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-44852a03-54d3-4bb2-8fdc-7c81d76208a3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.262549 Jun 23 09:24:37.460427 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 52/97] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:37 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:37.618646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:37.619376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:37.627856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:37.628392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:37.629232 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:37.629868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:37.773873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:37.781852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:37.783483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:37.784767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-354f51d9-5666-464d-b174-15896362812b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.171320 Jun 23 09:24:37.785339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 46/98] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:37 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:38.326620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-aadcfcd2-932b-452b-9271-4febb8ac707b req-dcc69f9c-adc0-489e-81ba-0f353de6ac93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead81496-995d-41ce-8a52-0c61545053f7", "name": "network-vif-plugged", "status": "completed", "tag": "3ed4c870-26d7-4fa7-9842-6dc0b9ff1906"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:38.335422 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-aadcfcd2-932b-452b-9271-4febb8ac707b req-dcc69f9c-adc0-489e-81ba-0f353de6ac93 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.346706 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-aadcfcd2-932b-452b-9271-4febb8ac707b req-dcc69f9c-adc0-489e-81ba-0f353de6ac93 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.348316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:38.348928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:38.357873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.358323 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.359186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.359623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.367857 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-aadcfcd2-932b-452b-9271-4febb8ac707b req-dcc69f9c-adc0-489e-81ba-0f353de6ac93 service nova] Creating event network-vif-plugged:3ed4c870-26d7-4fa7-9842-6dc0b9ff1906 for instance ead81496-995d-41ce-8a52-0c61545053f7 on hv-cinder-84727 Jun 23 09:24:38.373397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-aadcfcd2-932b-452b-9271-4febb8ac707b req-dcc69f9c-adc0-489e-81ba-0f353de6ac93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.515579 Jun 23 09:24:38.374401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 53/99] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:38.382731 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=100 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:38.473618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:38.475557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:38.524172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.524172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.524172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.524172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.566225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:38.581464 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3550548b-5208-48bc-9d42-3b277d8f4635 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.229224 Jun 23 09:24:38.581464 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 47/100] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:38 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:38.639205 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:38.641310 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a53c97fc-f7a7-4597-9343-f71fd7e28e58 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.175579 Jun 23 09:24:38.642698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 54/101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:38 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:38.896432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:38.896432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:38.896432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.896432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.898618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:38.898618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:38.944444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:38.959965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:38.961465 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:38.962565 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-96335b1c-9c36-4d94-baca-362dad4949e6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.163095 Jun 23 09:24:38.963146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 48/102] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:38 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:39.599794 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:39.600722 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:39.619251 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:39.620290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:39.621397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:39.622869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:39.660782 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:39.661524 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:39.672263 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:39.673342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:39.675084 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:39.675791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:39.874127 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:39.889072 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-50db84a0-1826-4b72-a042-2d2f6ba5c1ca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.231915 Jun 23 09:24:39.901808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 49/103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:39 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:39.975683 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:39.982109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:39.987183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:39.999665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-bbdbc970-92d1-4013-961a-896133b06e10 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.408587 Jun 23 09:24:40.009466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 55/104] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:39 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:40.010073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:40.010073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:40.010073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:40.010073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:40.262728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:40.274157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:40.276618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:40.279174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8b5d0ecb-c9df-403d-b921-3b9a06008698 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.300928 Jun 23 09:24:40.280524 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 50/105] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:39 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:40.393890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-dd5c0b7b-90af-4035-b2de-4e80297542d7 req-173fc9b1-f4d0-4b60-acb5-dd2ff832d7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "name": "network-vif-plugged", "status": "completed", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:40.402409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-dd5c0b7b-90af-4035-b2de-4e80297542d7 req-173fc9b1-f4d0-4b60-acb5-dd2ff832d7f6 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:40.403687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-dd5c0b7b-90af-4035-b2de-4e80297542d7 req-173fc9b1-f4d0-4b60-acb5-dd2ff832d7f6 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:40.415891 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-dd5c0b7b-90af-4035-b2de-4e80297542d7 req-173fc9b1-f4d0-4b60-acb5-dd2ff832d7f6 service nova] Creating event network-vif-plugged:a29b275b-5e50-40ac-a543-defb30d49ca9 for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b on hv-cinder-84727 Jun 23 09:24:40.422256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-dd5c0b7b-90af-4035-b2de-4e80297542d7 req-173fc9b1-f4d0-4b60-acb5-dd2ff832d7f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031849 Jun 23 09:24:40.423650 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 56/106] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:40.910154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:40.910730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:40.917262 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:40.918689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:40.918689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:40.919168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:41.021278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:41.022037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:41.039954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:41.039954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:41.039954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:41.040577 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:41.133065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:41.144728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b82df9bf-ac8c-4643-bb07-4a2d0c17d21a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1322 microversion: 2.1 time: 0.238339 Jun 23 09:24:41.146015 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 51/107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:40 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:41.231248 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:41.239752 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-21ed5804-dbde-44b0-8255-98789d2e3da5 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.225376 Jun 23 09:24:41.240424 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 57/108] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:41 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:41.297928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:41.298703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:41.305140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:41.305590 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:41.306353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:41.306790 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:41.664298 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:41.673750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:41.675377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:41.676563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-291de5a0-d9ed-4e8b-890e-916cca4b8346 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1407 microversion: 2.20 time: 0.382776 Jun 23 09:24:41.677196 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 52/109] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:41 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:42.163267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:42.169272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:42.176646 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.177109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.177887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.178327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.257478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:42.258183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:42.264399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.265833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.266869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.267552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.398236 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:42.410125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b611b0da-778e-4ecb-9064-95435efe838d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1517 microversion: 2.1 time: 0.251284 Jun 23 09:24:42.420620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 58/110] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:42 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:42.430302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:42.431302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:42.438891 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.439373 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.443552 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.444064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.507084 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:42.530803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'flavor' on Instance uuid ead81496-995d-41ce-8a52-0c61545053f7 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:24:42.534679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7d98fae5-746c-494b-8bc2-53e9a4c0ea4b tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.280883 Jun 23 09:24:42.535642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 53/111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:42 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:42.549833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-58e42d4e-76b5-44cc-a363-12875f7f30a1 req-2bf40df6-d0bd-40b3-94d4-f38f80000d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4921354-594f-4b15-b3f2-47a3d838f851", "name": "network-vif-plugged", "status": "completed", "tag": "4945a4dc-aecf-48ce-bab1-065123f856ba"}, {"server_uuid": "6d3d67ef-4a97-4375-951b-a9b4913c9328", "name": "network-vif-plugged", "status": "completed", "tag": "b14d8f63-9bec-4c93-a616-82eccf48fea9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:42.564472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-58e42d4e-76b5-44cc-a363-12875f7f30a1 req-2bf40df6-d0bd-40b3-94d4-f38f80000d29 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.565285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-58e42d4e-76b5-44cc-a363-12875f7f30a1 req-2bf40df6-d0bd-40b3-94d4-f38f80000d29 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.591766 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-58e42d4e-76b5-44cc-a363-12875f7f30a1 req-2bf40df6-d0bd-40b3-94d4-f38f80000d29 service nova] Creating event network-vif-plugged:4945a4dc-aecf-48ce-bab1-065123f856ba for instance d4921354-594f-4b15-b3f2-47a3d838f851 on hv-cinder-84727 Jun 23 09:24:42.592358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-58e42d4e-76b5-44cc-a363-12875f7f30a1 req-2bf40df6-d0bd-40b3-94d4-f38f80000d29 service nova] Creating event network-vif-plugged:b14d8f63-9bec-4c93-a616-82eccf48fea9 for instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 on hv-cinder-84727 Jun 23 09:24:42.592963 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-58e42d4e-76b5-44cc-a363-12875f7f30a1 req-2bf40df6-d0bd-40b3-94d4-f38f80000d29 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 09:24:42.594195 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-930365aa-d601-482e-b45e-20592b60c735 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.594690 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-930365aa-d601-482e-b45e-20592b60c735 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.596837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-930365aa-d601-482e-b45e-20592b60c735 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.596837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-930365aa-d601-482e-b45e-20592b60c735 None None] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.605906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.compute.rpcapi [None req-930365aa-d601-482e-b45e-20592b60c735 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 09:24:42.607047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-930365aa-d601-482e-b45e-20592b60c735 None None] Releasing lock "compute-rpcapi-router" {{(pid=118501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 09:24:42.627579 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-930365aa-d601-482e-b45e-20592b60c735 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081282 Jun 23 09:24:42.628174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 54/112] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:42.700741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:42.702102 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:42.726971 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.727719 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.728696 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.729436 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.927000 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a36b2d23-6510-412d-8e6e-baefd3a83589 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7/action" status: 200 len: 32 microversion: 2.1 time: 0.500573 Jun 23 09:24:42.927932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 59/113] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:24:42 2022] POST /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 09:24:42.939315 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:42.940043 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:42.940511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:42.948017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.948822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.949104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:42.951535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.951672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:42.957512 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.957866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e3a308bf-ddff-4b4b-9d1f-1862a242769e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1598 microversion: 2.20 time: 0.262587 Jun 23 09:24:42.957866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 55/114] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:24:42 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1598 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:24:42.978657 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:42.982934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:42.986404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.987137 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:42.988247 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:42.988962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:43.132508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2203b8c9-c926-42ff-99cb-038fb90be317 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158099 Jun 23 09:24:43.133791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 56/115] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Jun 23 09:24:42 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 09:24:43.234302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:43.242229 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4f909e7b-dd68-4e38-b4e2-53be9d974e8b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.309057 Jun 23 09:24:43.242817 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 60/116] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:42 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:43.552856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:43.554316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:43.567344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:43.569627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:43.570709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:43.571364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:44.131134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:44.139031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-67fc47b6-195e-4a40-8626-11211e17c1b8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.590036 Jun 23 09:24:44.139565 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 57/117] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:43 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:44.260052 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:44.260665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:44.266680 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:44.267155 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:44.267913 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:44.268350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:44.400258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:44.408241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-15cb629f-cbb2-4cf3-ace7-c75f3bf222e8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.152017 Jun 23 09:24:44.408807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 61/118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:44 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:45.176944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:45.176944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:45.176944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:45.176944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:45.177595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:45.177595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:45.425757 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:45.426436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:45.432266 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:45.433804 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:45.434358 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:45.435337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:45.435806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:45.440692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-84497fd9-a6f7-41b0-97b7-4b31c8e6c2a0 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.286708 Jun 23 09:24:45.441634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 58/119] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:45 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:45.581974 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:45.589952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e8727a50-c800-42cc-8937-a241bc4ad5fd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.168492 Jun 23 09:24:45.590523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 62/120] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:45 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:46.272792 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-4ddb77bc-adba-40af-824c-8ff2539b1035 req-0d137743-4ff6-44ab-8ddb-77a91faf6c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:46.289256 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-4ddb77bc-adba-40af-824c-8ff2539b1035 req-0d137743-4ff6-44ab-8ddb-77a91faf6c5c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:46.289780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-4ddb77bc-adba-40af-824c-8ff2539b1035 req-0d137743-4ff6-44ab-8ddb-77a91faf6c5c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:46.304182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-4ddb77bc-adba-40af-824c-8ff2539b1035 req-0d137743-4ff6-44ab-8ddb-77a91faf6c5c service nova] Creating event network-changed:a29b275b-5e50-40ac-a543-defb30d49ca9 for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b on hv-cinder-84727 Jun 23 09:24:46.309126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-4ddb77bc-adba-40af-824c-8ff2539b1035 req-0d137743-4ff6-44ab-8ddb-77a91faf6c5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039893 Jun 23 09:24:46.309713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 59/121] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:46.462629 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:46.463903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:46.470495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:46.471503 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:46.472498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:46.473287 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:46.607257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:46.608226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:46.619648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:46.620105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:46.623229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:46.629904 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:46.645148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:46.659932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6329d08e-17c4-48ad-a314-9ce6083fecb2 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.201809 Jun 23 09:24:46.660511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 63/122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:46 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:46.777486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:46.785108 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-dd1c5d57-2e20-4705-bae2-bbf829bcd1f8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.182157 Jun 23 09:24:46.785784 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:46 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:47.677407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:47.678242 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:47.684747 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:47.685195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:47.685970 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:47.686412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:47.804088 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:47.805388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:47.811662 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:47.812110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:47.813541 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:47.813974 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:47.817517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:47.824825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1c1e45d3-9500-4274-9520-b9d68724a9f9 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.151266 Jun 23 09:24:47.825395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 64/124] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:47 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:47.947604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:47.958055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d22b0db9-f2cf-4c14-bb88-176f16ab49ea tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.159770 Jun 23 09:24:47.958630 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 61/125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:47 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:48.841945 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:48.842610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:48.851719 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:48.852169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:48.852923 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:48.853363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:48.974618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:48.975267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:48.983305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:48.983965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:48.985417 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:48.986107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:48.994802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:49.002335 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e198d823-4ba3-4208-ab6c-4c7ac15940d6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.164588 Jun 23 09:24:49.002906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 65/126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:48 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:49.125567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:49.133809 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-320d4ebe-1f0f-44c7-a32f-5624fdb252c5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.162870 Jun 23 09:24:49.134642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 62/127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:48 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:50.019032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:50.019648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:50.025580 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:50.026030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:50.026787 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:50.027244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:50.157693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:50.158398 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:50.162346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:50.165597 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:50.166039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:50.166807 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:50.167679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:50.170049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7a8d58be-e3bb-4e0b-9851-7fece6a69e45 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.154851 Jun 23 09:24:50.171038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 66/128] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:50 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:50.304516 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:50.313143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d2459924-740b-4752-a3db-d22043eef526 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.165971 Jun 23 09:24:50.313797 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 63/129] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:50 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:51.186379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:51.187011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:51.193528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:51.194160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:51.211890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:51.211890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:51.329487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:51.330438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:51.336002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:51.336814 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:51.337475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:51.338580 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:51.339788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:51.348086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-41ee1936-3ac7-4ac9-a5aa-8b9bb5d323ef tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1315 microversion: 2.1 time: 0.165434 Jun 23 09:24:51.348681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 67/130] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:51 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:51.488450 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:51.496065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-89456df7-fcb8-4055-8884-b41389953c2b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.170384 Jun 23 09:24:51.496762 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 64/131] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:51 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:52.365401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:52.366090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:52.373267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:52.377899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:52.377899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:52.377899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:52.515541 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:52.516625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:52.523624 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:52.525661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:52.525661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:52.526064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:52.553473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=100 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:52.560187 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:52.564219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:52.579848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-748d15e9-5f56-4cf0-b431-863c4276e976 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1502 microversion: 2.1 time: 0.215850 Jun 23 09:24:52.580559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 68/132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:52 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:52.603587 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:52.825057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:52.833499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-58c0bbd2-05d8-44a9-a86b-c8ffb9ca9e33 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.324007 Jun 23 09:24:52.834040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 65/133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:52 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:53.850750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:53.851296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:53.858428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:53.862486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:53.862486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:53.862486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:53.992094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:54.000202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d4312093-0e39-4765-8115-f877847322a2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.152881 Jun 23 09:24:54.000772 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:53 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:55.018312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:55.018928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:55.025388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:55.025825 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:55.026578 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:55.027042 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:55.163721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:55.171228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0c070b2e-7969-4aa3-91ff-d45d66ad7c2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.157891 Jun 23 09:24:55.171861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 66/135] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:55 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:56.187927 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:56.188536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:56.194864 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:56.195334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:56.196090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:56.196523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:56.326317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:56.333866 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8aa4be8e-fb42-4394-a841-8f500852e580 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.150115 Jun 23 09:24:56.334425 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 70/136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:56 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:57.350154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:57.350995 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:57.357157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:57.357612 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:57.358629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:57.359443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:57.495940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:57.504298 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5e8ea996-4cb9-447e-8de7-dfb2f6d0aecb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.158071 Jun 23 09:24:57.504999 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 67/137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:57 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:24:57.991809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65776262-1f6f-4712-9178-92d8c43b105e"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:24:57.993585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:58.003565 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:58.004257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:58.005247 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:58.007944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:58.524593 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:58.525954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:58.532122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:58.532833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:58.533601 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:58.534033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:58.674491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:58.683541 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9c32eaaa-cfb3-4b6d-b23b-25573022a761 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.165529 Jun 23 09:24:58.687040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 68/138] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:58 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:24:59.533969 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5d47b601-4433-4fe0-9054-080147316dc8 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "POST /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.546680 Jun 23 09:24:59.542318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 71/139] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:24:57 2022] POST /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328/os-volume_attachments => generated 194 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:24:59.701498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:24:59.702073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:24:59.709554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:59.710003 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:59.710796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:24:59.711259 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:24:59.851900 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:24:59.859572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-db400730-b3bf-4639-a5d0-f2db5c12cc3e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.162044 Jun 23 09:24:59.860141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 69/140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:24:59 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:00.877414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:00.878110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:00.880561 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=65 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:00.885722 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:00.886166 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:00.886930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:00.887382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:01.033803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:01.041541 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a1432b7d-b9c7-44a8-80cc-74edaad2f991 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.168862 Jun 23 09:25:01.042376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 72/141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:00 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:02.059348 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:02.060252 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:02.066980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:02.067513 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:02.068274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:02.068701 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:02.223632 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:02.231526 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fcd330f0-cae2-45c4-8e08-ef4a2c9c1d26 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.175907 Jun 23 09:25:02.232090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 70/142] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:02 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:03.254506 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:03.256293 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:03.263290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:03.263741 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:03.264751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:03.265207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:03.417564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:03.425035 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b7bc0e53-c887-4c72-aef5-05071a1218a5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.174928 Jun 23 09:25:03.425611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 73/143] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:03 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:04.443498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:04.448873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:04.463334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:04.464636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:04.465428 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:04.466330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:04.612105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:04.619726 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d61eeb79-cf1d-4af6-8462-80b4720bde6c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.181701 Jun 23 09:25:04.620307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 71/144] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:04 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:05.641880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:05.643240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:05.651961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:05.652476 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:05.653315 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:05.653919 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:05.814112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:05.821454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e55938d8-b2bf-4772-b007-933ea24977af tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.187782 Jun 23 09:25:05.822042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 74/145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:05 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:06.838554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:06.840074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:06.846060 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=66 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:06.847730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:06.848355 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:06.849120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:06.849873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:06.999880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:07.008467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-167ad5c1-f453-4519-add0-b0db761cf5bf tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.174139 Jun 23 09:25:07.013262 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 72/146] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:06 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:08.026525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:08.027136 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:08.034105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:08.034548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:08.035322 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:08.035755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:08.177419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:08.185040 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3b3d4155-e7ee-46da-98bf-8f1b0d2c76fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.162403 Jun 23 09:25:08.185603 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:08 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:09.201615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:09.202176 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:09.208732 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:09.209176 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:09.209936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:09.210367 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:09.340305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:09.347953 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b9f36690-54cd-4bbc-b2e5-10e5a2d7d586 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.150280 Jun 23 09:25:09.348518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 73/148] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:09 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:10.366531 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:10.367369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:10.373606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:10.374072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:10.375368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:10.375803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:10.504103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:10.512775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-44cb7a99-e309-453f-a6d6-7f7c9f80740d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.150447 Jun 23 09:25:10.513118 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:10 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:11.529862 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:11.530468 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:11.537239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:11.537682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:11.538434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:11.538863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:11.668646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:11.679978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b42d76ea-ef4f-4446-86e7-8ea9f3555519 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.152885 Jun 23 09:25:11.679978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 74/150] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:11 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:12.698262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:12.699928 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:12.719222 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:12.721897 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:12.723031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:12.723442 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:12.895828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:12.905141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-71a30b48-62ea-4f2d-af3f-d001df1831d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.212015 Jun 23 09:25:12.905718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 77/151] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:12 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:13.356881 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:13.357404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:13.364113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:13.364563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:13.365378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:13.365817 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:13.391316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:25:13.761574 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6f66bda1-6c3c-4d32-a8e7-4cd718c6b829 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 204 len: 0 microversion: 2.1 time: 0.408400 Jun 23 09:25:13.762069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:25:13 2022] DELETE /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:25:13.772193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:13.772193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:13.777549 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:13.777999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:13.778763 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:13.779281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:13.908836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:13.916745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1c2b57f3-8f49-4616-9320-131823eae46c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1554 microversion: 2.1 time: 0.150268 Jun 23 09:25:13.917314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 78/153] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:13 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:13.924406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:13.925108 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:13.931205 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:13.932577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:13.932577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:13.932858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:14.086137 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:14.087616 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8986486f-0dd1-4d11-a7d6-519911b0b224 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.168024 Jun 23 09:25:14.088369 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 76/154] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:13 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:14.934888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:14.935531 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:14.944704 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:14.945154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:14.946004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:14.946785 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:15.114801 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:15.116332 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:15.123727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:15.138234 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:15.143337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2f9d92cc-da76-479f-8bf9-49e57318797e tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1554 microversion: 2.1 time: 0.213489 Jun 23 09:25:15.144103 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:15.145123 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:15.145782 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:15.160204 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 79/155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:14 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:15.331311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:15.339338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fdbc3186-1261-40f4-90f0-e4c19fe22909 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.236435 Jun 23 09:25:15.340683 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 77/156] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:15 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:16.165605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:16.166738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:16.186175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:16.186175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:16.186175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:16.186175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:16.356529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:16.357689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:16.366281 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:16.366966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:16.368205 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:16.369348 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:16.420623 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:16.438943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4c3c6997-be05-478d-a77d-9381736bc5b1 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1554 microversion: 2.1 time: 0.277031 Jun 23 09:25:16.446469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 80/157] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:16 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:16.755705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:16.770043 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7723016e-72a0-4f74-9f55-5bc99cca2668 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.417183 Jun 23 09:25:16.774392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 78/158] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:16 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:17.460943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:17.460943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:17.471770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:17.473096 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:17.475428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:17.476622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:17.541741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-e8395355-edc4-4334-a59e-186d21cb0984 req-ca9fc308-fa1e-4cee-a88c-c304d7fbe183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3d67ef-4a97-4375-951b-a9b4913c9328", "name": "network-vif-deleted", "tag": "b14d8f63-9bec-4c93-a616-82eccf48fea9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:17.551334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-e8395355-edc4-4334-a59e-186d21cb0984 req-ca9fc308-fa1e-4cee-a88c-c304d7fbe183 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:17.551773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-e8395355-edc4-4334-a59e-186d21cb0984 req-ca9fc308-fa1e-4cee-a88c-c304d7fbe183 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:17.564443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-e8395355-edc4-4334-a59e-186d21cb0984 req-ca9fc308-fa1e-4cee-a88c-c304d7fbe183 service nova] Creating event network-vif-deleted:b14d8f63-9bec-4c93-a616-82eccf48fea9 for instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 on hv-cinder-84727 Jun 23 09:25:17.570517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-e8395355-edc4-4334-a59e-186d21cb0984 req-ca9fc308-fa1e-4cee-a88c-c304d7fbe183 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Jun 23 09:25:17.571454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 79/159] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:25:17.605494 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:17.655756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2a34f785-1824-404c-bfaf-9e33113d9f3c tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1512 microversion: 2.1 time: 0.202320 Jun 23 09:25:17.657327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 81/160] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:17 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:17.790866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:17.791669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:17.801163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:17.809395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:17.809395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:17.809395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:17.944894 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:17.952502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1fee9846-2447-49d9-bd49-5527af329205 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.166450 Jun 23 09:25:17.953682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 80/161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:17 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:18.678588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:18.679225 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:18.685858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:18.686309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:18.687105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:18.687542 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:18.722782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:18.723300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:18.727746 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lazy-loading 'fault' on Instance uuid 6d3d67ef-4a97-4375-951b-a9b4913c9328 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:25:18.772006 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7f2d909d45471fb0b97ddb724cb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0160aecb23854482b26d188beec1021d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:18.781448 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e9ad968b-b217-46cf-bfc1-cb96f9b8a9e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 200 len: 1351 microversion: 2.1 time: 0.106154 Jun 23 09:25:18.782955 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 82/162] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:18 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:18.974880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:18.974880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:18.977045 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:18.977566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:18.978402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:18.978905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:18.983351 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:19.221487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:19.252668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b9e12bf1-17ed-4e83-a30c-0dc3de47e02d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.286810 Jun 23 09:25:19.259977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 81/163] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:18 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:19.799952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:19.800563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:19.807173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:19.807613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:19.808371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:19.808797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:19.822459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] HTTP exception thrown: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Request method failure captured: Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 HTTP/1.1 Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDE1iNByHbTpo4NbCHjKZlPiQsZzRgZcbIZl2KLuDg-TZj1EN5NhO3M_Jrh2oQk9Y4F9VcHlhh1_jaZ7lPutEaJ4bdcgn8mAYW87IJ3F0ERVUBOwzR3GmquWLZoTJS-aooTt2jCooPZQrkpsF7X1KH_EkqX8ocMPcWn3CdngWmg0Rvs Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:25:19.827355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0160aecb23854482b26d188beec1021d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0160aecb23854482b26d188beec1021d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 6e7f2d909d45471fb0b97ddb724cb195 Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.828934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '6d3d67ef-4a97-4375-951b-a9b4913c9328'} Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:25:19.829731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.830937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.832110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Returning 404 to user: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:25:19.832110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-052a1227-1f79-4133-a3ad-01656cb1e061 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 404 len: 111 microversion: 2.1 time: 0.033216 Jun 23 09:25:19.832110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 83/164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:19 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:25:19.934325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:19.935313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:19.941964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:19.942375 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:19.943161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:19.943594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:19.956572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] HTTP exception thrown: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Request method failure captured: Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328/os-volume_attachments HTTP/1.1 Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDE1iNByHbTpo4NbCHjKZlPiQsZzRgZcbIZl2KLuDg-TZj1EN5NhO3M_Jrh2oQk9Y4F9VcHlhh1_jaZ7lPutEaJ4bdcgn8mAYW87IJ3F0ERVUBOwzR3GmquWLZoTJS-aooTt2jCooPZQrkpsF7X1KH_EkqX8ocMPcWn3CdngWmg0Rvs Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:25:19.968249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0160aecb23854482b26d188beec1021d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0160aecb23854482b26d188beec1021d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 6e7f2d909d45471fb0b97ddb724cb195 Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.970274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'server_id': '6d3d67ef-4a97-4375-951b-a9b4913c9328'} Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:25:19.971135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:19.972475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:19.973792 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Returning 404 to user: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:25:19.973792 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8b3fe394-5c16-46ce-bcbd-6545a548b998 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039886 Jun 23 09:25:19.973792 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 82/165] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:25:19 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:25:20.271891 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:20.272511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:20.278534 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:20.279014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:20.279772 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:20.280396 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:20.299166 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:20.444262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:20.447727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9f352b78-dcaa-4912-a105-6f9f350ddb8c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.179551 Jun 23 09:25:20.448894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 84/166] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:20 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:21.450582 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:21.451881 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:21.462478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:21.463041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:21.464005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:21.464763 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:21.465789 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:21.466553 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:21.475534 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:21.475920 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:21.476874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:21.477317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:21.481679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] HTTP exception thrown: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Request method failure captured: Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: DELETE /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 HTTP/1.1 Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDE1iNByHbTpo4NbCHjKZlPiQsZzRgZcbIZl2KLuDg-TZj1EN5NhO3M_Jrh2oQk9Y4F9VcHlhh1_jaZ7lPutEaJ4bdcgn8mAYW87IJ3F0ERVUBOwzR3GmquWLZoTJS-aooTt2jCooPZQrkpsF7X1KH_EkqX8ocMPcWn3CdngWmg0Rvs Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:25:21.484679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0160aecb23854482b26d188beec1021d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0160aecb23854482b26d188beec1021d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 6e7f2d909d45471fb0b97ddb724cb195 Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.486219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '6d3d67ef-4a97-4375-951b-a9b4913c9328'} Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:25:21.487186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.488605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.490888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Returning 404 to user: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:25:21.490888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-24725242-855c-4a45-8533-c090c8eb9b23 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 404 len: 111 microversion: 2.1 time: 0.039681 Jun 23 09:25:21.490888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 83/167] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:25:21 2022] DELETE /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:25:21.497346 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:21.500309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] [instance: 6d3d67ef-4a97-4375-951b-a9b4913c9328] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:21.505442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:21.506049 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:21.506893 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:21.507431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:21.521254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] HTTP exception thrown: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Request method failure captured: Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 HTTP/1.1 Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDE1iNByHbTpo4NbCHjKZlPiQsZzRgZcbIZl2KLuDg-TZj1EN5NhO3M_Jrh2oQk9Y4F9VcHlhh1_jaZ7lPutEaJ4bdcgn8mAYW87IJ3F0ERVUBOwzR3GmquWLZoTJS-aooTt2jCooPZQrkpsF7X1KH_EkqX8ocMPcWn3CdngWmg0Rvs Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:25:21.522883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0160aecb23854482b26d188beec1021d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0160aecb23854482b26d188beec1021d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0160aecb23854482b26d188beec1021d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 0160aecb23854482b26d188beec1021d Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-DeleteServersTestJSON-1434905987 Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 6e7f2d909d45471fb0b97ddb724cb195 Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-DeleteServersTestJSON-1434905987-project Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.524392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '6d3d67ef-4a97-4375-951b-a9b4913c9328'} Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:25:21.525218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. Jun 23 09:25:21.526594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:25:21.534488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] Returning 404 to user: Instance 6d3d67ef-4a97-4375-951b-a9b4913c9328 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:25:21.534488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4d5aa66b-3add-4911-af3c-ad275c9379e6 tempest-DeleteServersTestJSON-1434905987 tempest-DeleteServersTestJSON-1434905987-project] 10.222.0.52 "GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328" status: 404 len: 111 microversion: 2.1 time: 0.037881 Jun 23 09:25:21.534488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 84/168] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:21 2022] GET /compute/v2.1/servers/6d3d67ef-4a97-4375-951b-a9b4913c9328 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:25:21.647157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:21.654770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1c65e52f-d89c-4f5c-ad09-6c17bffb7b8d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.193226 Jun 23 09:25:21.666396 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 85/169] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:21 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:22.674599 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:22.675250 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:22.682059 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:22.682509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:22.685330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:22.691352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:23.000291 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:23.013749 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b68744ba-a1f7-45cc-9cec-76f4d38f0bc2 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.344824 Jun 23 09:25:23.014326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 85/170] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:22 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:24.033882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:24.034761 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:24.047752 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:24.050249 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:24.051090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:24.054539 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:24.264345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:24.271863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3fe64dd6-236f-4d5d-9c88-a8aa974aaec8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1523 microversion: 2.1 time: 0.243095 Jun 23 09:25:24.272389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 86/171] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:24 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:25.293703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:25.297025 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:25.314139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:25.314576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:25.315392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:25.315836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:25.575743 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:25.583709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0c90c060-6c7b-498f-83f5-2fbe82253fe1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1503 microversion: 2.1 time: 0.298378 Jun 23 09:25:25.584379 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 86/172] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:25 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:25.601040 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:25.602361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:25.611486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:25.612675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:25.614295 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:25.614980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:25.773451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:25.780057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9dde1df7-74d9-4811-9d20-a90ac27b5723 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1515 microversion: 2.1 time: 0.183328 Jun 23 09:25:25.796986 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 87/173] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:25 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:28.150342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:28.151751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:28.159011 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:28.159646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:28.160515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:28.161208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:28.187026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'flavor' on Instance uuid d4921354-594f-4b15-b3f2-47a3d838f851 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:25:28.583547 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-67a49f20-7a27-46fd-a91c-34cb419dee14 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/action" status: 200 len: 32 microversion: 2.1 time: 0.437150 Jun 23 09:25:28.584164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 87/174] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:25:28 2022] POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/action => generated 32 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:25:28.593362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:28.593973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:28.601303 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:28.601764 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:28.602563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:28.603034 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:28.731545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:28.739672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0c277efd-5ac2-410a-bc44-62ba623211b1 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.150305 Jun 23 09:25:28.740231 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 88/175] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:28 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:29.757468 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:29.758088 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:29.765440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:29.765896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:29.766660 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:29.767136 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:29.966421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:29.974454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d6c6d496-e409-4731-9d04-faec4debac35 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.221343 Jun 23 09:25:29.975035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 88/176] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:29 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:30.992047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:30.992653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:30.996014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=36 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:31.001453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:31.001900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:31.005240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:31.005240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:31.149781 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:31.164940 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4c255586-b911-43d7-ada5-89929346aa42 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.176758 Jun 23 09:25:31.165750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 89/177] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:30 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:32.188065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:32.188683 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:32.195588 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:32.196027 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:32.197000 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:32.197430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:32.465905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:32.476382 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4330f723-2b2a-4855-bb62-2022e45bcc6b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.297076 Jun 23 09:25:32.478376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 89/178] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:32 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:32.816499 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:32.817119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:32.824214 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:32.826824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:32.826824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:32.826824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:32.850287 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0ac00be3-4adc-43da-b5ee-580e3684da0c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/ips" status: 200 len: 151 microversion: 2.20 time: 0.038273 Jun 23 09:25:32.851112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 90/179] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Jun 23 09:25:32 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:25:33.497947 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:33.499258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:33.505939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:33.515952 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:33.518972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:33.518972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:33.706303 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:33.714538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-56413d4d-0c52-4b38-88ee-cdda2d6e091a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.220651 Jun 23 09:25:33.715450 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 90/180] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:33 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:34.732235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:34.732952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:34.740664 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:34.741390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:34.744380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:34.744380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:34.884756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:34.894372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-edcdadb3-002a-477a-8f4a-c488a5344206 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.166362 Jun 23 09:25:34.904648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 91/181] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:34 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:35.685961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-128c4676-da83-45c7-baf1-6b218e496188 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: .version_select at 0x7f8270bccdc0>, body: {"keypair": {"name": "tempest-keypair-2079230074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPV1dwoutsVt1LAsS60QJB9NtwOBvu67wJ45EaWS7astFJbvBXYvOj1etUpzxjFPk0zrv8Odc9G+xvqigWNnfvA3uByqpvsiqO57oA5b/Fy8gqK0KoFFHKiAaodERn1PBg=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:35.701213 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-128c4676-da83-45c7-baf1-6b218e496188 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:25:35.705330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-128c4676-da83-45c7-baf1-6b218e496188 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:25:35.882842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-128c4676-da83-45c7-baf1-6b218e496188 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.345291 Jun 23 09:25:35.884444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 91/182] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:25:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:25:35.917772 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:35.918419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:35.925539 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:35.927134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:35.927134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:35.927356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:36.073475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:36.081348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-04b95fc7-200a-44a3-85aa-b139653a7ecd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.172779 Jun 23 09:25:36.081929 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 92/183] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:35 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:37.097908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:37.099362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:37.102602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:37.110517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:37.110998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:37.112147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:37.112685 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:37.266211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:37.273652 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9f77b2e9-3cb8-4824-a7ec-ccaddbbb888c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.179860 Jun 23 09:25:37.274208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 92/184] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:37 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:38.293157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:38.293707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:38.301858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:38.302402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:38.303611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:38.304046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:38.455510 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:38.465175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-402167c2-0377-4aa6-a35d-14ec87abbaf5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.177431 Jun 23 09:25:38.475681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 93/185] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:38 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:39.038251 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-116766652", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "308c25e5-5cce-431f-b4d9-9d80a125cd28"}], "security_groups": [{"name": "tempest-securitygroup--2084903866"}], "key_name": "tempest-keypair-2079230074", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:39.167063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] validate_networks() for [('308c25e5-5cce-431f-b4d9-9d80a125cd28', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:25:39.491489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:39.492022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:39.498727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:39.499942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:39.500724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:39.501152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:39.552663 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:25:39.553378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:25:39.553849 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:25:39.554419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:25:39.554804 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:25:39.564206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:39.564840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:39.565865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:39.567395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:39.589443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:25:39.594404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:25:39.606304 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:25:39.608955 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:25:39.645359 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:39.652683 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6c0f5509-fd58-456a-984f-d9dd67a6873a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.165575 Jun 23 09:25:39.653242 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 94/186] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:39 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:39.847665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b1542855-e10a-4ecf-9d43-574d9461d2ad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.814060 Jun 23 09:25:39.848406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 93/187] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:25:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:25:39.858524 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c9a65f23-0d4d-44b9-b8be-db2e13b3f3ea tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:39.861171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c9a65f23-0d4d-44b9-b8be-db2e13b3f3ea tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:39.922460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c9a65f23-0d4d-44b9-b8be-db2e13b3f3ea tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:39.930702 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c9a65f23-0d4d-44b9-b8be-db2e13b3f3ea tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1241 microversion: 2.1 time: 0.076362 Jun 23 09:25:39.931787 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 95/188] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:39 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:40.669619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:40.670184 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:40.677128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:40.687409 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:40.687409 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:40.687409 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:40.811732 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:40.819172 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-87b648e3-af78-4eca-a74f-3986c3bfda86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.154039 Jun 23 09:25:40.819730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 94/189] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:40 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:40.955343 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-428bcaf4-10aa-4b8a-bffa-fcdb17d2af5a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:40.955955 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-428bcaf4-10aa-4b8a-bffa-fcdb17d2af5a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:41.012977 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-428bcaf4-10aa-4b8a-bffa-fcdb17d2af5a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:41.028623 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-428bcaf4-10aa-4b8a-bffa-fcdb17d2af5a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1241 microversion: 2.1 time: 0.077333 Jun 23 09:25:41.029377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 96/190] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:40 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:41.958052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:41.958052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:41.958052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:41.958052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:41.959326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:41.959326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:41.979746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:41.987357 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1cc3c8c0-80b1-43b7-8d97-47d1a263d2ed tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.154723 Jun 23 09:25:41.993819 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 95/191] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:41 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:42.055420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:42.055420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:42.055420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:42.055420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:42.056151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:42.056151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:42.084887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:42.085513 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:42.091746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:42.092400 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:42.093175 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:42.093612 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:42.119876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:42.120039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lazy-loading 'flavor' on Instance uuid bd6f6f87-f812-4fe4-98a4-86bab5a8d39b {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:25:42.123825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-251f7a72-eb00-4b5b-a34e-e232c611287e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1245 microversion: 2.1 time: 0.081441 Jun 23 09:25:42.131474 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 97/192] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:42 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:42.873842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e2a716aa-d78a-4ab9-b930-78b7c2bfd883 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/action" status: 202 len: 0 microversion: 2.20 time: 0.792576 Jun 23 09:25:42.877707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 96/193] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jun 23 09:25:42 2022] POST /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:25:42.882666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:42.883367 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:42.889511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:42.890043 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:42.890814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:42.891289 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:43.009996 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:43.010689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:43.017498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:43.017941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:43.018702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:43.018925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:43.019163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:43.027148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:43.028806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:43.029818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6bec5287-c9bb-4c3d-8904-60789800364b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.150967 Jun 23 09:25:43.031148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 98/194] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:42 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:43.038710 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:43.141631 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:43.142320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:43.151480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:43.151480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:43.151480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:43.151880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:43.154557 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:43.164978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d6487594-a3d5-4f47-a311-39ed90ee5eb0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.159174 Jun 23 09:25:43.165555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 97/195] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:43 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:43.226169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:43.234171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-07ec75b4-6143-4f0c-9e05-ae778e5597fa tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1245 microversion: 2.1 time: 0.097037 Jun 23 09:25:43.234729 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 99/196] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:43 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:44.050424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:44.052052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:44.056711 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:44.057154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:44.058046 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:44.058344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:44.181801 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:44.182496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:44.189324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:44.189856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:44.190695 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:44.191229 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:44.202618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:44.211091 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:44.212613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:44.213898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-eccd0002-0c34-49ed-addc-bf0a6092a6cd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.169046 Jun 23 09:25:44.214856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 98/197] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:44 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:44.253392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:44.253993 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:44.260613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:44.261056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:44.261816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:44.262300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:44.331999 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:44.344677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8418b382-99c5-4637-8e39-4581e561fdca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1293 microversion: 2.1 time: 0.094301 Jun 23 09:25:44.345214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 99/198] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:44 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:44.346790 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:44.355529 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1fc08647-8062-47e4-af42-9214f3a49276 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.177700 Jun 23 09:25:44.359633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 100/199] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:44 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:45.232975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:45.234529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:45.240675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:45.241133 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:45.241900 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:45.242345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:45.367712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:45.371636 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:45.381196 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:45.383039 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:45.383039 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:45.383313 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:45.386465 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:45.394411 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:45.395933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:45.397078 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4e36da0d-e411-4615-9fb5-f95ea644f8d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.168047 Jun 23 09:25:45.397639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 100/200] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:45 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:45.401932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:45.403264 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:45.409280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:45.409738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:45.410509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:45.410967 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:45.446040 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:45.454715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a549f23d-c1a5-4e6d-aa83-dc7fa41d3724 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1293 microversion: 2.1 time: 0.090647 Jun 23 09:25:45.455351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 101/201] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:45 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:45.539833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:45.548709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-add3bf5b-112c-4148-a8aa-5eb13ab26d93 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.150133 Jun 23 09:25:45.549272 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 101/202] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:45 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:46.415179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:46.415718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:46.422114 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:46.422555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:46.423353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:46.423786 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:46.471491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:46.472098 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:46.478041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:46.478488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:46.479268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:46.479696 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:46.547421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:46.549833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-89b3f013-9832-4677-910a-20ac22aee083 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1293 microversion: 2.1 time: 0.081979 Jun 23 09:25:46.550397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 102/203] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:46 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:46.556743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:46.565362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:46.565919 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:46.566561 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:46.566868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:46.568049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-68b970e5-3484-4ef6-a29b-086e259d6fda tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.156773 Jun 23 09:25:46.568774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 102/204] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:46 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:46.572517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:46.572961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:46.573748 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:46.574181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:46.703908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:46.712266 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-96f3b27f-f646-47a8-9a0e-e7ef54980b86 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.150754 Jun 23 09:25:46.712891 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 103/205] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:46 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:47.567102 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:47.567982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:47.575259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:47.575813 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:47.576683 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:47.577744 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:47.585897 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:47.586504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:47.592497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:47.593563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:47.594496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:47.595132 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:47.600353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:47.649598 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:47.659873 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-27897cb1-3741-4d94-8c28-d7b3698c60d7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1293 microversion: 2.1 time: 0.097128 Jun 23 09:25:47.660779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 103/206] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:47 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:47.730409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:47.731319 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:47.736263 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:47.745867 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:47.747086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:47.753994 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:47.754113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:47.754207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:47.754207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:47.754347 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c652965e-d678-486b-977a-3241eeacd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.167503 Jun 23 09:25:47.754347 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 104/207] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:47 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:47.884365 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:47.901660 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-973babff-069e-4440-80cc-9af2f76b192d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.174272 Jun 23 09:25:47.906957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 104/208] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:47 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:48.676818 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:48.677339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:48.683375 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:48.683906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:48.684749 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:48.685173 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:48.746553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:48.754104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-12c6eca2-ed65-4223-9d13-f2c7bfcee171 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1293 microversion: 2.1 time: 0.081176 Jun 23 09:25:48.754662 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 105/209] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:48 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:48.767875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:48.768485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:48.774973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:48.775423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:48.776179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:48.776612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:48.900366 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:48.908784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:48.910296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:48.911474 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ad2439d0-4919-4fa1-85b8-abdce1bf003d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.147552 Jun 23 09:25:48.912038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 105/210] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:48 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:48.923672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:48.924275 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:48.930227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:48.930605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:48.931410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:48.931839 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:49.059674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:49.067141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2f28b33d-4664-4295-8047-9dc4e85abfad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.147986 Jun 23 09:25:49.067702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 106/211] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:48 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:49.771441 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:49.771970 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:49.778451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:49.778893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:49.779672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:49.780724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:49.846838 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:49.854358 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-50d52784-e6b7-40b5-b693-ffb5c61a8ee7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1293 microversion: 2.1 time: 0.086797 Jun 23 09:25:49.854931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 106/212] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:49 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:49.930013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:49.930646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:49.933624 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:49.934289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=10 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:49.937887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:49.938341 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:49.939138 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:49.939577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:50.070574 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:50.079099 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:50.080612 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:50.081758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-41fd0876-8fe4-404f-80ea-58bdbc599d19 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.155706 Jun 23 09:25:50.082310 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 107/213] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:49 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:50.084368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:50.085036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:50.090880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:50.091341 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:50.092094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:50.092525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:50.227188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:50.234826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2102571b-1e5c-47cd-8b1c-33106b402017 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.154193 Jun 23 09:25:50.235820 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 107/214] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:50 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:50.870873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:50.871625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:50.877739 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:50.878190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:50.878966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:50.879405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:50.939431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:50.946879 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ac6eac5f-761b-446f-a6f5-4183816e545b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1301 microversion: 2.1 time: 0.079777 Jun 23 09:25:50.947460 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 108/215] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:50 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:51.100611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:51.103689 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:51.104364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:51.110261 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:51.110707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:51.111496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:51.111926 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:51.251581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:51.252207 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:51.258446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:51.258883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:51.259699 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:51.260125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:51.398560 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:51.407890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:51.409386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:51.411263 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b72ac82e-1da5-472a-b138-d720ad4385bf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.315153 Jun 23 09:25:51.414968 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 108/216] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:51 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:51.459819 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:51.473437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cdc2c56d-c15f-4de3-83d0-ca335cbe0fd7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.225571 Jun 23 09:25:51.490687 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 109/217] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:51 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:51.967647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:51.970071 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:51.981449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:51.981835 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:51.982615 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:51.983116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:52.070639 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:52.085305 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b036bb5c-a51a-4e5f-8b95-21b3c699200e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1311 microversion: 2.1 time: 0.118935 Jun 23 09:25:52.085305 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 109/218] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:51 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:52.429651 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:52.430255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:52.437919 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:52.438366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:52.439151 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:52.439579 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:52.495775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:52.495775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:52.500103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:52.500751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:52.501529 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:52.501957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:52.644983 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:52.653002 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:52.654713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:52.656110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7ed5cd07-3ff9-4573-864e-be46e2c0b47f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.230323 Jun 23 09:25:52.657163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 110/219] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:52 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:52.657658 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:52.665618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-97edce71-99f0-4ba3-9fbf-86232208ea64 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.178408 Jun 23 09:25:52.676446 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 110/220] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:52 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:53.095856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:53.096459 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:53.102386 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.102826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.103603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.104033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.570330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:53.579483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-86b001f6-5667-4222-92b6-8ce5c116b8e3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.487673 Jun 23 09:25:53.580987 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 111/221] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:53 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:53.676909 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:53.678208 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:53.682176 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:53.682869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:53.685295 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.685829 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.686798 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.687717 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.689352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.689897 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.691838 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.692317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.827290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:53.835279 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:53.836914 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:53.837925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-20f48af2-9b64-443f-94af-8d22e5fd62a8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.165148 Jun 23 09:25:53.850364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 111/222] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:53 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:53.864681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-905ecaf1-89fd-4646-8a59-d7946a902801 req-1bfa0ee0-78ec-4959-b028-07e82eabcccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a229b3-a377-4881-9f1c-769d10ba375b", "tag": "d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:53.874215 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-905ecaf1-89fd-4646-8a59-d7946a902801 req-1bfa0ee0-78ec-4959-b028-07e82eabcccd service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.874997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-905ecaf1-89fd-4646-8a59-d7946a902801 req-1bfa0ee0-78ec-4959-b028-07e82eabcccd service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.886622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-905ecaf1-89fd-4646-8a59-d7946a902801 req-1bfa0ee0-78ec-4959-b028-07e82eabcccd service nova] Creating event network-changed:d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3 for instance f0a229b3-a377-4881-9f1c-769d10ba375b on hv-cinder-84727 Jun 23 09:25:53.891892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-905ecaf1-89fd-4646-8a59-d7946a902801 req-1bfa0ee0-78ec-4959-b028-07e82eabcccd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031474 Jun 23 09:25:53.892724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 112/223] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:25:53.906902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:53.916346 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ed50c795-2fb7-42fe-973b-8e42a30c64cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1501 microversion: 2.1 time: 0.238496 Jun 23 09:25:53.917397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 112/224] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:53 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:53.939186 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4df481f4-70a6-43e0-af28-824d8681466c"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:53.940611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:53.967072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.967072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.967072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:53.967072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:53.999221 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] HTTP exception thrown: Cannot 'attach_volume' instance d4921354-594f-4b15-b3f2-47a3d838f851 while it is in vm_state rescued Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Request method failure captured: Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/os-volume_attachments HTTP/1.1 Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 74 Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDEzg9sac6w2TmnHl3QCOiv3EI8SyhHECSSQh1A_NSxH37E0bYlp251nhzcT1WsvKjQpRhQQEJLyzjcaUluEGWysd1ORnr4SUf6fqsB3wJnVn2BTqCxv_8lGQonkM8VpP0x5Ml-ydKCbKjiWjefMJECQgfmqSwmNd_ndi8ZTgzcyCVg Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:25:54.001724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_368a6f8fbca64e7791d5330f0a99d086", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 29fe5fb181e2452388d24fd0b7aa5e9f Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {"volumeAttachment": {"volumeId": "4df481f4-70a6-43e0-af28-824d8681466c"}} Jun 23 09:25:54.003652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Cannot 'attach_volume' instance d4921354-594f-4b15-b3f2-47a3d838f851 while it is in vm_state rescued Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'server_id': 'd4921354-594f-4b15-b3f2-47a3d838f851', 'body': {'volumeAttachment': {'volumeId': '4df481f4-70a6-43e0-af28-824d8681466c'}}} Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4921354-594f-4b15-b3f2-47a3d838f851 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:25:54.005497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d4921354-594f-4b15-b3f2-47a3d838f851 while it is in vm_state rescued Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:25:54.006652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:25:54.007991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:25:54.007991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:25:54.007991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d4921354-594f-4b15-b3f2-47a3d838f851 while it is in vm_state rescued Jun 23 09:25:54.007991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:25:54.007991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Returning 409 to user: Cannot 'attach_volume' instance d4921354-594f-4b15-b3f2-47a3d838f851 while it is in vm_state rescued {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:25:54.007991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-25b9956c-ce1f-472c-af40-13b3bf8ff73f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073115 Jun 23 09:25:54.010935 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 113/225] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:25:53 2022] POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 09:25:54.018206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:25:54.018748 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:54.033097 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.033609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.034447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.035215 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.094958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=100 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:54.365559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-74445f38-2848-4712-9228-763baafc534c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/action" status: 202 len: 0 microversion: 2.1 time: 0.351735 Jun 23 09:25:54.366277 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 113/226] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:25:54 2022] POST /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:25:54.375353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:54.375962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:54.383787 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.384244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.385016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.385451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.528447 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:54.536188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3a0c27d1-5f3f-440d-a9de-66a506cb683f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1509 microversion: 2.1 time: 0.165453 Jun 23 09:25:54.536743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 114/227] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:54 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:54.599882 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:54.601135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:54.607598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.608145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.609509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.609949 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.742529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:54.750754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d0e87c91-ccc6-4016-9462-b896f32e378f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.155176 Jun 23 09:25:54.751345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 114/228] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:54 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:54.861774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:54.862386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:54.873556 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.874038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:54.878489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:54.878489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:55.362120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:55.372521 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:55.380421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:55.381032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-207b72cf-a8c3-4918-b03c-42d909e26d78 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.527749 Jun 23 09:25:55.381705 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 115/229] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:54 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:55.555712 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:55.556789 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:55.566478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:55.566945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:55.570410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:55.571388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:55.758870 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:55.767081 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:55.767691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:55.769618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-05de8da1-db55-4f35-bf87-93f1ad71cdf3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1509 microversion: 2.1 time: 0.218587 Jun 23 09:25:55.770345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 115/230] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:55 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:55.773776 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:55.774220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:55.775045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:55.775477 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:55.910179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:55.917754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ce3253fb-096c-4e12-b20e-1c3059f847b5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.155107 Jun 23 09:25:55.918705 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 116/231] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:55 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:56.404556 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:56.405720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:56.422043 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:56.424970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:56.425794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:56.426352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:56.587414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:56.596349 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:56.597913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:56.599314 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5a00feea-2762-425f-a68a-0f66bbbb96db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.202120 Jun 23 09:25:56.599850 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 116/232] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:56 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:56.787314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:56.788117 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:56.794849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:56.795500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:56.796400 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:56.797167 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:56.930997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:56.934039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:56.935160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:56.942496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:56.955957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:56.956135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8c3d7a75-2b74-4dd2-9319-b5e4f5cc1d70 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1509 microversion: 2.1 time: 0.160210 Jun 23 09:25:56.956254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:56.956254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:56.956423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 117/233] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:56 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:57.124308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:57.133287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9636d2a2-706b-479a-bfae-b13585f24b92 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.203392 Jun 23 09:25:57.133972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 117/234] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:56 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:57.617537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:57.618134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:57.624846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:57.625295 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:57.626065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:57.626569 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:57.758973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:57.771000 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:57.772697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:57.774020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-024e5b98-15d4-49ec-9286-addf6ec282e9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.160374 Jun 23 09:25:57.774584 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 118/235] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:57 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:57.964899 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:57.965515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:57.973634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:57.973980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:57.978807 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:57.979180 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:58.139015 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:58.147554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fb5d55b1-64f8-47ad-9f5a-48c45e785877 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1509 microversion: 2.1 time: 0.187824 Jun 23 09:25:58.148292 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 118/236] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:57 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:58.159601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:58.160229 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:58.166730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:58.167222 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:58.168457 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:58.169060 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:58.326964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:58.326964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-84c4e89a-3eb2-4b3a-83fd-fd0ff7baa3c9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.176437 Jun 23 09:25:58.326964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 119/237] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:58 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:58.792653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:58.793261 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:58.799827 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:58.800263 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:58.801012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:58.801442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:58.929004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:58.936842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:58.938337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:58.939507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f4af5ea1-a1fb-429b-865c-bc6662edf799 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.150693 Jun 23 09:25:58.940071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 119/238] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:58 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:25:59.165057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:59.165659 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:59.172188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:59.172633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:59.173394 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:59.173825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:59.332371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:59.339962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:59.340709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:59.346045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f18fa7d0-b9d6-4663-9211-35bfdef19fca tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1509 microversion: 2.1 time: 0.180802 Jun 23 09:25:59.346045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 120/239] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:59 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:25:59.365119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:59.365923 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:59.366944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:59.367594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:59.521308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:25:59.530537 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fc6c648c-36d0-4edf-b7f7-3f6035781c74 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.194960 Jun 23 09:25:59.531239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 120/240] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:25:59 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:25:59.957155 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:25:59.957978 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:25:59.964327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:59.964765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:59.965515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:25:59.968638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:25:59.971032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:00.113146 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:00.123637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:00.123637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:00.123889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f930e7a6-4469-45ff-b887-4edcf3008ee4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1744 microversion: 2.20 time: 0.170968 Jun 23 09:26:00.124297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 121/241] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:25:59 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:00.360931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:00.361542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:00.367625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:00.368364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:00.368821 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:00.369253 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:00.503353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:00.511364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5c1555f3-b061-4e76-bc8e-77849d754f18 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1509 microversion: 2.1 time: 0.154508 Jun 23 09:26:00.512187 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 121/242] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:00 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:00.563519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:00.564177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:00.572302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:00.572902 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:00.573768 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:00.574376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:00.810042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:00.824783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d3ae4f5e-e5ce-43e2-9a70-56a879a5e3eb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.278164 Jun 23 09:26:00.826333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 122/243] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:00 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:01.141406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:01.142308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:01.155139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:01.155760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:01.163786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:01.163786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:01.311961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:01.321267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:01.333459 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:01.334702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2a4b9e2b-4f1f-4284-95ae-7e6138c99cea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1744 microversion: 2.20 time: 0.197107 Jun 23 09:26:01.335853 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 122/244] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:01 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:01.528759 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:01.529094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:01.537115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:01.537708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:01.538698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:01.539353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:01.784706 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:01.794645 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b074c7f6-6a6e-4c35-b18d-c79658593143 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1515 microversion: 2.1 time: 0.270721 Jun 23 09:26:01.807102 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 123/245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:01 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1515 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:01.842223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:01.843471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:01.852374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:01.852838 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:01.853591 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:01.854292 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:02.079693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:02.087902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fee70736-910a-470d-b08a-606ab75d9caf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.249523 Jun 23 09:26:02.088941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 123/246] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:01 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:02.356972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:02.357699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:02.365638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:02.366084 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:02.366848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:02.367314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:02.541832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:02.566667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:02.566667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:02.568832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ed9f9cd8-2d59-4a4a-ba1f-840e2b620154 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1744 microversion: 2.20 time: 0.216915 Jun 23 09:26:02.568832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 124/247] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:02 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:03.105901 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:03.106819 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:03.113026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:03.113292 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:03.114065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:03.114498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:03.260452 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:03.268076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d234bcf6-26f0-48d1-b2fa-c1ce8e4d79d2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.166162 Jun 23 09:26:03.268631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 124/248] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:03 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:03.589288 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:03.589288 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:03.593501 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=76 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:03.601709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:03.602354 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:03.603362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:03.603982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:03.786005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:03.793891 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:03.795463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:03.797861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4ed8d7ae-598c-4624-87fe-597e80c2db75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.213677 Jun 23 09:26:03.797861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 125/249] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:03 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:03.946163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-c3aa80b4-2a56-4aba-af53-2949a4d1a114 req-7365245f-9434-4b83-b927-9a90c3df6785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a229b3-a377-4881-9f1c-769d10ba375b", "name": "network-vif-plugged", "status": "completed", "tag": "d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:03.959360 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-c3aa80b4-2a56-4aba-af53-2949a4d1a114 req-7365245f-9434-4b83-b927-9a90c3df6785 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:03.961467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-c3aa80b4-2a56-4aba-af53-2949a4d1a114 req-7365245f-9434-4b83-b927-9a90c3df6785 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:03.989241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-c3aa80b4-2a56-4aba-af53-2949a4d1a114 req-7365245f-9434-4b83-b927-9a90c3df6785 service nova] Creating event network-vif-plugged:d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3 for instance f0a229b3-a377-4881-9f1c-769d10ba375b on hv-cinder-84727 Jun 23 09:26:04.005948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-c3aa80b4-2a56-4aba-af53-2949a4d1a114 req-7365245f-9434-4b83-b927-9a90c3df6785 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063779 Jun 23 09:26:04.006768 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 125/250] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:04.015323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4dba0ad5-2767-4606-b683-e1e1e1355cbe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'create', calling method: .version_select at 0x7f8271458940>, body: {"keypair": {"name": "tempest-keypair-1783668015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRbNgJN6oX3ZHYdd3n78UsGDIgrZJcWATS/HVkXGav1vgWht01HZnigBDngNjFFkMUdN66fxk2GPhxdEtanSFK4BkdjSvjJJjrNnriBbd0u9G+ms/0fT/phJ9S4MFVo3Q=="}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:04.045917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-4dba0ad5-2767-4606-b683-e1e1e1355cbe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:26:04.049397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-4dba0ad5-2767-4606-b683-e1e1e1355cbe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for user 29fe5fb181e2452388d24fd0b7aa5e9f and project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:26:04.271884 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4dba0ad5-2767-4606-b683-e1e1e1355cbe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257488 Jun 23 09:26:04.277697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 126/251] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:26:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:04.289184 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:04.290745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:04.304693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:04.317152 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:04.317152 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:04.317152 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:04.610841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:04.628487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-56482d79-14e4-4b11-88c9-375f4f288d1f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.343911 Jun 23 09:26:04.629133 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 126/252] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:04 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:04.816319 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:04.816933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:04.831211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:04.831898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:04.837655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:04.838361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:05.007670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:05.019184 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:05.023318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:05.024602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-23de5581-1728-40b2-94e9-9448ff8bcc3c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.213021 Jun 23 09:26:05.025422 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 127/253] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:04 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:05.647412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:05.648065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:05.672584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:05.672584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:05.675123 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:05.675576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:06.029717 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-0125d5c4-3dc1-47cd-bef9-db0f38f07b4b req-bdb298ff-646e-477e-8f79-64ad3e628214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "name": "network-vif-plugged", "status": "completed", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:06.056447 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-0125d5c4-3dc1-47cd-bef9-db0f38f07b4b req-bdb298ff-646e-477e-8f79-64ad3e628214 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:06.057092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-0125d5c4-3dc1-47cd-bef9-db0f38f07b4b req-bdb298ff-646e-477e-8f79-64ad3e628214 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:06.075193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-0125d5c4-3dc1-47cd-bef9-db0f38f07b4b req-bdb298ff-646e-477e-8f79-64ad3e628214 service nova] Creating event network-vif-plugged:a29b275b-5e50-40ac-a543-defb30d49ca9 for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b on hv-cinder-84727 Jun 23 09:26:06.083140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:06.094821 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4e84d7d1-ce26-4a23-8277-ae6236295d71 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1367 microversion: 2.1 time: 0.451194 Jun 23 09:26:06.095978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 127/254] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:05 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:06.101557 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:06.102690 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:06.122174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:06.122174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:06.122174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:06.122174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:06.127249 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-0125d5c4-3dc1-47cd-bef9-db0f38f07b4b req-bdb298ff-646e-477e-8f79-64ad3e628214 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081677 Jun 23 09:26:06.131100 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 128/255] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:26:06.362087 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:06.389795 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:06.392255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:06.398160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8e835362-ece2-4df6-8f65-3f8e02d56106 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.300903 Jun 23 09:26:06.399055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 128/256] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:06 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:07.117200 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:07.117881 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:07.131988 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:07.136629 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:07.160915 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:07.160915 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:07.416963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:07.422239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:07.425794 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-264f7b5b-2cea-4cbc-afe2-ac00687ed4f4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1557 microversion: 2.1 time: 0.314533 Jun 23 09:26:07.430314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 129/257] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:07 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1557 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:07.445500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:07.448300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:07.448743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:07.463349 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:07.464206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:07.467911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:07.474621 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:07.481326 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:07.488062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:07.488062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:07.488062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:07.629545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-85f0f944-1d0c-4f9b-be4d-c9c8a8ce8f86 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184442 Jun 23 09:26:07.630505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 130/258] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:26:07 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:26:07.856337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:07.871414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:07.873512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:07.876017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-676b0172-41a4-44cd-a33e-41407ce0ed98 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.459933 Jun 23 09:26:07.879563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 129/259] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:07 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:08.907047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:08.908507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:08.930573 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:08.931155 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:08.931855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:08.932407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:09.113533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:09.124314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:09.126874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:09.128937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-49823e3f-633c-48a3-a77e-feb1cabdd255 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.228947 Jun 23 09:26:09.130466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 131/260] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:08 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:09.631971 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-603641681", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9023da2-9c4b-4934-b1b2-3b253a92c58b"}], "security_groups": [{"name": "tempest-securitygroup--1360291563"}], "key_name": "tempest-keypair-1783668015", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:09.747353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-4641135a-4f9b-4242-a9ea-b37b83755533 req-0339f512-2a37-4e9b-b85c-a5432a427b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a229b3-a377-4881-9f1c-769d10ba375b", "tag": "d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:09.757580 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4641135a-4f9b-4242-a9ea-b37b83755533 req-0339f512-2a37-4e9b-b85c-a5432a427b24 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:09.758025 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4641135a-4f9b-4242-a9ea-b37b83755533 req-0339f512-2a37-4e9b-b85c-a5432a427b24 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:09.784049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-4641135a-4f9b-4242-a9ea-b37b83755533 req-0339f512-2a37-4e9b-b85c-a5432a427b24 service nova] Creating event network-changed:d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3 for instance f0a229b3-a377-4881-9f1c-769d10ba375b on hv-cinder-84727 Jun 23 09:26:09.793909 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-4641135a-4f9b-4242-a9ea-b37b83755533 req-0339f512-2a37-4e9b-b85c-a5432a427b24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051441 Jun 23 09:26:09.801234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 132/261] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:26:10.151401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:10.153536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:10.165911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:10.166594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:10.168853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:10.168853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:10.633807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:10.655745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:10.660522 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:10.664153 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9539bb26-6143-4e2f-9450-45cdbe85d401 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.518083 Jun 23 09:26:10.664779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 133/262] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:10 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:11.683262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:11.684153 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:11.701416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:11.701416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:11.701416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:11.702214 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:11.880701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:11.895637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:11.898810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:11.900705 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cafa7175-f012-4ce8-ba6a-02cc48477a46 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.221380 Jun 23 09:26:11.902247 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 134/263] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:11 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:12.930841 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:12.932773 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:12.941885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:12.942418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:12.943508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:12.944020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:13.118041 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:13.126783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:13.128324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:13.129476 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6c205c9c-8b79-4997-99b1-65c41e8177dd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.211727 Jun 23 09:26:13.130039 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 135/264] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:12 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:14.159177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:14.160855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:14.189769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:14.191685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:14.198480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:14.199539 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:14.200023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:14.435150 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:14.449668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:14.453320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:14.455105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a5fd8f82-8a10-4e35-9265-72b61ea927bd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.310570 Jun 23 09:26:14.456187 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 136/265] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:14 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:14.872699 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] validate_networks() for [('f9023da2-9c4b-4934-b1b2-3b253a92c58b', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:26:15.179486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:15.466737 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:26:15.468308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:26:15.476802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:15.479141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:26:15.481086 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:26:15.481964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:15.483730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:26:15.510256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:15.520035 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:15.521155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:15.521372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:15.521811 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:15.522160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:15.522942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:15.523490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:15.606627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:26:15.616978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Getting quotas for user 29fe5fb181e2452388d24fd0b7aa5e9f and project 368a6f8fbca64e7791d5330f0a99d086. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:26:15.652161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:26:15.657373 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:26:15.763257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:15.773567 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:15.775331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:15.776614 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-97e1a7bc-7bfe-4c06-9eaa-90eb2750a75e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.306353 Jun 23 09:26:15.779341 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 137/266] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:15 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:15.923765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b7eaa357-aa8b-4487-82fb-762f38206edb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.295949 Jun 23 09:26:15.925502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 130/267] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:26:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 6298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:26:15.936245 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b5775399-5083-4795-bc4a-aa9653093d06 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:15.937055 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b5775399-5083-4795-bc4a-aa9653093d06 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:15.993470 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b5775399-5083-4795-bc4a-aa9653093d06 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:16.001620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b5775399-5083-4795-bc4a-aa9653093d06 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1245 microversion: 2.1 time: 0.069924 Jun 23 09:26:16.003662 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 138/268] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:15 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:16.796550 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:16.797503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:16.804805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:16.805437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:16.809988 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:16.809988 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:16.812073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:16.957668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:16.967105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:16.968912 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:16.970327 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3dc158de-a638-4426-8210-7fa721803707 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.178822 Jun 23 09:26:16.970971 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 131/269] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:16 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:17.020649 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:17.021370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:17.028826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:17.029268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:17.030086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:17.030517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:17.116111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:17.116111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-71bb61eb-ec90-4082-90c6-f5c99010d130 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1249 microversion: 2.1 time: 0.086129 Jun 23 09:26:17.116111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 139/270] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:17 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:17.761996 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-732029844", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "networks": [{"uuid": "c0764c8f-72a0-45ca-8ee9-2b6c8b4710bb"}]}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:17.810453 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] validate_networks() for [('c0764c8f-72a0-45ca-8ee9-2b6c8b4710bb', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:26:17.988830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:17.989429 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:17.995361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:17.995805 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:17.996562 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:17.996997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:18.136244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:18.151018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:18.151018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:18.151769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-de0f7d59-e162-459a-8608-94f62b67724c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.166823 Jun 23 09:26:18.152363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 140/271] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:17 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:18.157834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:18.158604 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:18.165687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:18.166148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:18.166957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:18.167405 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:18.192606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:18.197994 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:26:18.198511 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:26:18.198865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:26:18.199595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:26:18.200006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:26:18.215694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:18.216225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:18.222004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:18.223033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:18.242972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:18.252197 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-eab624f0-4e7c-4ea0-a115-2dd92c494246 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1249 microversion: 2.1 time: 0.098486 Jun 23 09:26:18.252801 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 141/272] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:18 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:18.382697 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Getting quotas for project 6a1a64d6d0f241739bb3dad4490182ed. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:26:18.386781 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Getting quotas for user 484c9ed8db294be9aaeb2a7e50afabe0 and project 6a1a64d6d0f241739bb3dad4490182ed. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:26:18.400315 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:26:18.402431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:26:18.636589 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0224a1e1-dbbf-450c-8299-78e588bc3eea tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878313 Jun 23 09:26:18.637245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 132/273] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:26:18.652594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d371f588-01a8-406f-8400-1a90f9757735 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:18.653562 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d371f588-01a8-406f-8400-1a90f9757735 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:18.762650 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d371f588-01a8-406f-8400-1a90f9757735 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:18.775340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d371f588-01a8-406f-8400-1a90f9757735 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1213 microversion: 2.1 time: 0.128208 Jun 23 09:26:18.776835 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 142/274] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:18 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:19.169904 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:19.171060 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:19.177888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:19.178338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:19.179143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:19.179583 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:19.270076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:19.270628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:19.277930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:19.278642 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:19.279642 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:19.280230 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:19.354289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:19.366235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:19.366567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:19.368272 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:19.369626 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8824faad-c224-4b53-ad93-4184bca68d03 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.203979 Jun 23 09:26:19.370429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 133/275] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:19 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:19.378866 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-04ce3d05-0343-4a15-a950-4e16378ec0d3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1297 microversion: 2.1 time: 0.113397 Jun 23 09:26:19.379783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 143/276] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:19 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1297 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:19.793096 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a5fab49a-d4d5-4cbe-ae2e-a4f7db9eec7f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:19.793700 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a5fab49a-d4d5-4cbe-ae2e-a4f7db9eec7f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:19.874668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a5fab49a-d4d5-4cbe-ae2e-a4f7db9eec7f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:19.881661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a5fab49a-d4d5-4cbe-ae2e-a4f7db9eec7f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1213 microversion: 2.1 time: 0.092391 Jun 23 09:26:19.884095 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 134/277] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:19 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:20.388501 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:20.389098 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:20.395974 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:20.396419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:20.397174 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:20.397607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:20.398110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:20.398789 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:20.405839 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:20.406288 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:20.407068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:20.407498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:20.474703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:20.482287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-acc0442c-72e1-4fe6-9db1-9d90d7d014d5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1305 microversion: 2.1 time: 0.088105 Jun 23 09:26:20.482971 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 135/278] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:20 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1305 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:20.590894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:20.599643 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:20.601398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:20.602549 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f3a85e0a-3aa3-4ac5-8ddd-de35f91ef882 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1739 microversion: 2.20 time: 0.218055 Jun 23 09:26:20.603143 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 144/279] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:20 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:20.898231 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:20.898761 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:20.909161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:20.910117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:20.910543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:20.911129 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:21.047349 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:21.055304 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7713967d-a54b-4bd3-9dda-6f8bfc20ec77 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1217 microversion: 2.1 time: 0.161038 Jun 23 09:26:21.059812 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 136/280] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:20 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:21.501172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:21.501783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:21.512978 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:21.513348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:21.516849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:21.517498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:21.624074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:21.624776 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:21.634167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:21.635116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:21.636798 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:21.637455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:21.815289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:21.824996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:21.834649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:21.836180 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-562b4cc7-1ae0-4363-88ca-d5ff50572490 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.339374 Jun 23 09:26:21.837283 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 145/281] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:21 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:21.839409 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:21.840796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-44ad019b-c0d5-4ddc-9356-91dc83534969 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1721 microversion: 2.20 time: 0.223015 Jun 23 09:26:21.841591 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 137/282] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:21 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:22.072788 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:22.073401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:22.081916 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.082423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:22.083162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.083613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:22.167278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:22.177151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ed83d2cc-8076-430f-bf2b-84409e36197b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1265 microversion: 2.1 time: 0.108128 Jun 23 09:26:22.187560 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 146/283] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:22 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:22.819008 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-97e98d02-41e2-4f31-aca5-9c1a0c419f3a req-39a70c37-af88-4e11-81bd-4ec7a4cc1cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65478370-c27f-44f4-a45f-0a5f2bc0dbe9", "tag": "d80dcfb6-742d-4015-9492-0b79f1b71413"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:22.830943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-97e98d02-41e2-4f31-aca5-9c1a0c419f3a req-39a70c37-af88-4e11-81bd-4ec7a4cc1cd0 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.831389 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-97e98d02-41e2-4f31-aca5-9c1a0c419f3a req-39a70c37-af88-4e11-81bd-4ec7a4cc1cd0 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:22.854146 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:22.854768 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:22.854964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-97e98d02-41e2-4f31-aca5-9c1a0c419f3a req-39a70c37-af88-4e11-81bd-4ec7a4cc1cd0 service nova] Creating event network-changed:d80dcfb6-742d-4015-9492-0b79f1b71413 for instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 on hv-cinder-84727 Jun 23 09:26:22.864483 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.864952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:22.865956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.867249 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:22.869665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-97e98d02-41e2-4f31-aca5-9c1a0c419f3a req-39a70c37-af88-4e11-81bd-4ec7a4cc1cd0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054714 Jun 23 09:26:22.870618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 138/284] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:22.880774 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:22.881539 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:22.888370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.889051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:22.890026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:22.890647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:23.054178 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:23.062815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8cc5b6ca-d61e-4751-9a25-c5de224bd2e9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.212742 Jun 23 09:26:23.063505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 147/285] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:22 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:23.090615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:23.090615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:23.090812 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:23.090812 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bb3e6a15-f07d-47a9-89f9-10451b40880a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1721 microversion: 2.20 time: 0.217663 Jun 23 09:26:23.090812 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 139/286] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:22 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:23.194574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:23.195250 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:23.202352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:23.202808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:23.203704 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:23.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:23.269693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:23.277709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c634a28a-f388-4d5f-8e0c-b28ae6359094 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1265 microversion: 2.1 time: 0.086900 Jun 23 09:26:23.278382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 148/287] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:23 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:24.081024 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:24.083533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:24.090055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:24.090055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:24.090863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:24.091342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:24.108855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:24.109463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:24.120771 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:24.121127 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:24.121925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:24.122359 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:24.356933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:24.386178 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:24.406103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:24.406103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b75206b3-9e3d-4faa-b3c7-7a71521d3b0f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1721 microversion: 2.20 time: 0.292283 Jun 23 09:26:24.409314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 149/288] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:24 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:24.428628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:24.429338 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:24.436713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:24.445936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-060d836e-e8ee-493b-aa8a-485aa09ccd55 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.370185 Jun 23 09:26:24.451017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 140/289] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:24 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:24.451904 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:24.462637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:24.463537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:24.463998 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:24.539075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:24.548417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-22e6dae0-91fb-4f77-aa15-76075dcd83fa tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1283 microversion: 2.1 time: 0.137259 Jun 23 09:26:24.553087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 150/290] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:24 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:25.427944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:25.428553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:25.434901 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.435448 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.436890 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.437445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.470734 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:25.471380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:25.479174 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.479620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.480388 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.480821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.574480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:25.582576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:25.584125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:25.585280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d8237832-caf2-423a-86c7-122efb8eb839 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1664 microversion: 2.20 time: 0.161273 Jun 23 09:26:25.585836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 141/291] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:25 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:25.590240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:25.591028 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:25.598022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.598474 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.599267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.599908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.658067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:25.668439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2e0cc53b-2d2b-4b5f-94bc-6f24a617c7fb tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.202422 Jun 23 09:26:25.675861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 151/292] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:25 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:25.675861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ec4dfac-0212-4b49-a26e-c12673c978a5"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:25.676692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:25.682889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.683370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.684306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.684745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.788787 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:25.797685 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-25d3543e-eb7e-4922-bad9-63a7e264a00f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.210825 Jun 23 09:26:25.811995 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 142/293] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:25 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:25.813661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-95f3e2a4-002a-43cd-b464-ebde2066e7a5 req-6d2905b2-1cd2-43ec-a703-498d3af04a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "name": "network-vif-unplugged", "status": "completed", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:25.821764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-95f3e2a4-002a-43cd-b464-ebde2066e7a5 req-6d2905b2-1cd2-43ec-a703-498d3af04a66 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:25.822248 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-95f3e2a4-002a-43cd-b464-ebde2066e7a5 req-6d2905b2-1cd2-43ec-a703-498d3af04a66 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:25.834009 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.compute.server_external_events [req-95f3e2a4-002a-43cd-b464-ebde2066e7a5 req-6d2905b2-1cd2-43ec-a703-498d3af04a66 service nova] Unable to find a host for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b. Dropping event network-vif-unplugged {{(pid=118501) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 09:26:25.834889 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-95f3e2a4-002a-43cd-b464-ebde2066e7a5 req-6d2905b2-1cd2-43ec-a703-498d3af04a66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026599 Jun 23 09:26:25.835489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 143/294] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 09:26:26.687904 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:26.688567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:26.700204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:26.700204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:26.700204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:26.700204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:26.944852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:26.954509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-99d1178d-8f70-4779-8bdb-86942a59e918 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.270289 Jun 23 09:26:26.964227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 144/295] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:26 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:26.969885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:26.970491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:26.976825 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:26.977272 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:26.978066 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:26.978764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:27.182594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:27.191330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-158b6a64-b988-4b00-8f4d-2dc667cc4991 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.225773 Jun 23 09:26:27.191916 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 145/296] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:26 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:27.197983 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-3bcf11f0-2e53-420a-b4e8-4f4d163af9a8 req-dcb14615-2835-4744-ba03-9949f22f30b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1", "tag": "1af03f42-b0af-4904-b2cd-5c086eec8f36"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:27.205315 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-3bcf11f0-2e53-420a-b4e8-4f4d163af9a8 req-dcb14615-2835-4744-ba03-9949f22f30b1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:27.205761 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-3bcf11f0-2e53-420a-b4e8-4f4d163af9a8 req-dcb14615-2835-4744-ba03-9949f22f30b1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:27.217766 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-3bcf11f0-2e53-420a-b4e8-4f4d163af9a8 req-dcb14615-2835-4744-ba03-9949f22f30b1 service nova] Creating event network-changed:1af03f42-b0af-4904-b2cd-5c086eec8f36 for instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 on hv-cinder-84727 Jun 23 09:26:27.222621 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-3bcf11f0-2e53-420a-b4e8-4f4d163af9a8 req-dcb14615-2835-4744-ba03-9949f22f30b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029575 Jun 23 09:26:27.223242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 146/297] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:27.400159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ea26292e-2b28-43b7-96d1-2e92e625f3b8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.728282 Jun 23 09:26:27.400768 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 152/298] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Jun 23 09:26:25 2022] POST /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments => generated 188 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:26:27.555239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:27.556112 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:27.564289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:27.564748 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:27.565531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:27.565976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:27.971895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:27.972506 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:27.979555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:27.980001 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:27.980776 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:27.981204 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:28.027114 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6710adf3-c6c5-4c83-b56b-92c7fb6afcb9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/action" status: 202 len: 0 microversion: 2.20 time: 0.479826 Jun 23 09:26:28.031680 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 147/299] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jun 23 09:26:27 2022] POST /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:26:28.037543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:28.038620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:28.049461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:28.049918 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:28.050734 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:28.051197 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:28.182991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:28.195018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5a1bc2dd-145c-4b02-87e2-0ea4cf38e857 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.226931 Jun 23 09:26:28.197406 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 153/300] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:27 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:28.212007 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:28.213609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:28.225083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:28.225970 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:28.227420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:28.228067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:28.284061 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:28.290486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:28.292222 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:28.293430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3cd84bab-10a7-41f2-915e-2f5b28a1e669 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1750 microversion: 2.20 time: 0.260255 Jun 23 09:26:28.294455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 148/301] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:28 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1750 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:28.509251 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:28.518786 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-37b8e7e8-3842-4387-aa36-6d16025078c7 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.313910 Jun 23 09:26:28.519402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 154/302] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:28 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:29.215627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:29.216381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:29.219055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=4 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:29.225849 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.226132 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.227406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.227858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.314085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:29.314724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:29.317680 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:29.322423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.323459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.324466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.324909 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.376760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:29.390264 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6d6d2c8d-e960-41a8-ab93-4a1125b32632 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.180054 Jun 23 09:26:29.391137 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 149/303] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:29 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:29.474831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:29.483117 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:29.484889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:29.486042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8e047e6b-51b5-4c87-a1ff-197cf9de8bfc tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1750 microversion: 2.20 time: 0.177482 Jun 23 09:26:29.486587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 155/304] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:29 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:29.536515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:29.537208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:29.543393 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.543834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.544594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.545534 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.564429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:29.704781 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:29.714955 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9b508692-1bf9-4722-96d3-b5deffbe8d87 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.180562 Jun 23 09:26:29.715677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 150/305] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:29 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:29.887476 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-03b0da30-3019-4232-b3dc-da3068396448 req-28e28f76-8531-410f-a762-e4471b362472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65478370-c27f-44f4-a45f-0a5f2bc0dbe9", "name": "network-vif-plugged", "status": "completed", "tag": "d80dcfb6-742d-4015-9492-0b79f1b71413"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:29.896154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-03b0da30-3019-4232-b3dc-da3068396448 req-28e28f76-8531-410f-a762-e4471b362472 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:29.896543 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-03b0da30-3019-4232-b3dc-da3068396448 req-28e28f76-8531-410f-a762-e4471b362472 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:29.908132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-03b0da30-3019-4232-b3dc-da3068396448 req-28e28f76-8531-410f-a762-e4471b362472 service nova] Creating event network-vif-plugged:d80dcfb6-742d-4015-9492-0b79f1b71413 for instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 on hv-cinder-84727 Jun 23 09:26:29.913311 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-03b0da30-3019-4232-b3dc-da3068396448 req-28e28f76-8531-410f-a762-e4471b362472 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029583 Jun 23 09:26:29.913897 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 156/306] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:30.407964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:30.408567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:30.410660 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=14 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:30.416112 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:30.416581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:30.417368 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:30.417802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:30.508203 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:30.508876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:30.516678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:30.524860 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:30.524860 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:30.524860 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:30.556138 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:30.602846 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:30.611016 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c7cbc2ac-33f1-4547-bc13-a9b1c6a1636b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.207668 Jun 23 09:26:30.611572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 151/307] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:30 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:30.734057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:30.734887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:30.735968 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:30.742028 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:30.742679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:30.743643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:30.744074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:30.765551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:30.765551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:30.765551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-80b5f7c3-cd58-46c6-844e-04ff51a5ca47 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1750 microversion: 2.20 time: 0.261820 Jun 23 09:26:30.765927 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 157/308] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:30 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1750 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:30.869865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:30.877067 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-626d43d3-eac0-47fc-b92b-786a4253b392 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.148226 Jun 23 09:26:30.877624 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 152/309] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:30 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:31.627675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:31.628288 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:31.635351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:31.635811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:31.636590 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:31.637010 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:31.781831 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:31.783010 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:31.791055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:31.791895 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:31.792898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:31.793529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:31.803989 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:31.813936 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6cc56fb8-b536-4876-802b-a7e75e1584cd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1371 microversion: 2.1 time: 0.190037 Jun 23 09:26:31.820632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 158/310] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:31 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:31.893448 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:31.894059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:31.900334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:31.903610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:31.903610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:31.903610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:31.923832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:31.932311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:31.933833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:31.935022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8fdcb43b-1333-4561-bccc-87aa4ed09512 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1752 microversion: 2.20 time: 0.157164 Jun 23 09:26:31.936192 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 153/311] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:31 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:32.090693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:32.125685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e526ea4b-0788-4940-a035-88a98a030eb5 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.223735 Jun 23 09:26:32.127919 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 159/312] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:31 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:32.831728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:32.832391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:32.838242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:32.838688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:32.839482 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:32.839918 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:32.955511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:32.956119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:32.965498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:32.969304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:32.969304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:32.969304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:32.989139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:32.996529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a89efb14-002c-48f6-86c5-a6ac3dc30d5b tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1565 microversion: 2.1 time: 0.168573 Jun 23 09:26:32.998689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 154/313] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:32 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:33.016940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:33.017643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:33.027333 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:33.028483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:33.029542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:33.030075 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:33.136733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6a23d8be-9151-4771-9709-c4da3e1685a8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126856 Jun 23 09:26:33.138179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 155/314] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:26:33 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:26:33.141281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:33.145233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:33.146358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:33.154617 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:33.158003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:33.159474 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0d639a56-1563-42ce-8186-2ed7bb6be592 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1752 microversion: 2.20 time: 0.208902 Jun 23 09:26:33.160663 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:33.161367 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:33.163107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:33.163752 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:33.174968 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 160/315] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:32 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:33.304059 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:33.314381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-811d3c18-3270-42bd-9469-1b1b030584e4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.172118 Jun 23 09:26:33.314381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 156/316] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:33 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:34.053098 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-4acbd7f6-e3bc-4e1f-9e36-c06da6e38106 req-1c362ca9-d934-4690-b3bc-09c6d12664fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1", "name": "network-vif-plugged", "status": "completed", "tag": "1af03f42-b0af-4904-b2cd-5c086eec8f36"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:34.065212 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4acbd7f6-e3bc-4e1f-9e36-c06da6e38106 req-1c362ca9-d934-4690-b3bc-09c6d12664fe service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:34.065943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4acbd7f6-e3bc-4e1f-9e36-c06da6e38106 req-1c362ca9-d934-4690-b3bc-09c6d12664fe service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:34.083902 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-4acbd7f6-e3bc-4e1f-9e36-c06da6e38106 req-1c362ca9-d934-4690-b3bc-09c6d12664fe service nova] Creating event network-vif-plugged:1af03f42-b0af-4904-b2cd-5c086eec8f36 for instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 on hv-cinder-84727 Jun 23 09:26:34.089342 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-4acbd7f6-e3bc-4e1f-9e36-c06da6e38106 req-1c362ca9-d934-4690-b3bc-09c6d12664fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040350 Jun 23 09:26:34.090585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 161/317] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:34.177976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:34.178734 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:34.186167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:34.186617 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:34.187408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:34.187841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:34.331292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:34.333043 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:34.341066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:34.341793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:34.342952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:34.343924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:34.430244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:34.440450 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:34.442448 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:34.444342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ead1d36e-1849-47d1-824b-83c97b7c6e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.269796 Jun 23 09:26:34.455013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 157/318] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:34 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:34.607775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:34.617154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4d383ebc-ef11-43f7-97e4-ead08065651c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.290991 Jun 23 09:26:34.617647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 162/319] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:34 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:34.852962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-6936afa1-9598-4d72-aa46-685de9828b55 req-b51d3954-8a87-46cc-bdd9-b7eab8b860a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65478370-c27f-44f4-a45f-0a5f2bc0dbe9", "tag": "d80dcfb6-742d-4015-9492-0b79f1b71413"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:34.862009 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-6936afa1-9598-4d72-aa46-685de9828b55 req-b51d3954-8a87-46cc-bdd9-b7eab8b860a1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:34.862444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-6936afa1-9598-4d72-aa46-685de9828b55 req-b51d3954-8a87-46cc-bdd9-b7eab8b860a1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:34.875872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-6936afa1-9598-4d72-aa46-685de9828b55 req-b51d3954-8a87-46cc-bdd9-b7eab8b860a1 service nova] Creating event network-changed:d80dcfb6-742d-4015-9492-0b79f1b71413 for instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 on hv-cinder-84727 Jun 23 09:26:34.896269 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-6936afa1-9598-4d72-aa46-685de9828b55 req-b51d3954-8a87-46cc-bdd9-b7eab8b860a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046769 Jun 23 09:26:34.903121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 158/320] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:35.466896 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:35.467518 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:35.475792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:35.477918 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:35.478755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:35.479337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:35.480187 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:35.633024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:35.636503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:35.638032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:35.646219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:35.648286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:35.649753 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fc6689c5-129f-4e34-93f0-711386aed1e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.192008 Jun 23 09:26:35.661557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 163/321] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:35 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:35.714716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:35.715278 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:35.716160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:35.716774 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:35.899354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:35.907764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c25cfed7-d801-4e5a-bd73-87ce131bc8dd tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1313 microversion: 2.1 time: 0.276808 Jun 23 09:26:35.909393 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 159/322] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:35 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:36.669217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:36.671149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:36.680381 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:36.683177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:36.685095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:36.699000 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:36.913699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:36.925870 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:36.927203 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:36.934735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:36.937362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:36.938094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:36.940661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:36.940810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ba51e983-fa01-4e63-9a82-c3b8e83b8e2d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.274547 Jun 23 09:26:36.940810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 164/323] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:36 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:36.940972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:36.940972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:37.362648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:37.379666 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5df227b8-2719-466c-8be1-8ca4afa0040e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1496 microversion: 2.1 time: 0.457978 Jun 23 09:26:37.380583 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 160/324] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:36 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1496 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:37.958056 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:37.959402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:37.976786 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:37.978061 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:37.979243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:37.979924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:38.298092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:38.329996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:38.331599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:38.333290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-77f8f144-e017-4937-a259-3222320f905b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.379812 Jun 23 09:26:38.334078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 165/325] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:37 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:38.853760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:38.854282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:38.862047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:38.865950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:38.865950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:38.865950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:38.898736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:26:39.213963 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:39.355419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:39.548032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:39.548032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:39.548032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:39.548032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:39.548607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:39.548607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:39.549412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:39.549412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:39.549412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-45cfb131-d41d-4663-8c7f-a51539550b58 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.155285 Jun 23 09:26:39.550020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 166/326] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:39 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:40.409252 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a6484059-0900-4d43-83e6-05bd25bdb4a2 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "DELETE /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 204 len: 0 microversion: 2.1 time: 1.559588 Jun 23 09:26:40.410496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 161/327] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:26:38 2022] DELETE /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 0 bytes in 1562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:26:40.418889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:40.419528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:40.438997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:40.443698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:40.443698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:40.443698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:40.556887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:40.557910 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:40.564839 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:40.565433 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:40.566277 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:40.566779 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:40.665246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:40.673901 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-53a86b4e-ece4-4984-a4a0-7d96f3437896 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.259280 Jun 23 09:26:40.675140 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 167/328] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:40 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:40.820020 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:40.832417 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:40.834738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:40.836406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-73429462-be27-476c-b3b9-535a46517c8e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.283675 Jun 23 09:26:40.847732 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 162/329] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:40 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:41.691980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:41.695342 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:41.702372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:41.703260 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:41.704564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:41.705364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:41.857769 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:41.859505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:41.869100 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:41.869820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:41.870861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:41.871706 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:41.981560 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:41.991926 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-78ef2cf6-3aaf-4c67-ae7d-51dcbba53cfb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.304199 Jun 23 09:26:41.992669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 168/330] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:41 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:42.024963 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:42.034607 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:42.036155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:42.037402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cdf4408e-d857-4035-bef0-3b5866c9946c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.186439 Jun 23 09:26:42.038285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 163/331] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:41 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:43.023044 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:43.025705 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:43.062238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:43.062713 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:43.063610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:43.065236 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:43.065909 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:43.068189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:43.073555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:43.074101 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:43.075150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:43.075957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:43.287019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:43.288582 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:43.290818 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:43.292603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f1f1a011-ebaa-4972-af5a-2affda6982d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.235158 Jun 23 09:26:43.304949 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 164/332] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:43 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:43.372957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:43.386765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-31c1c0cc-22e1-4170-a2e9-273f31832015 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.374441 Jun 23 09:26:43.398997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 169/333] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:43 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:44.314156 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:44.314773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:44.320851 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:44.321555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:44.322326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:44.322758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:44.405436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:44.406056 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:44.413075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:44.424496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:44.424496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:44.424496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:44.466466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:44.476007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:44.477589 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:44.479054 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4cf001c3-574f-4c9f-8ced-a595707562e8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.169794 Jun 23 09:26:44.479682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 165/334] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:44 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:44.569164 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:44.580725 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7c34d40c-a4cc-4d70-9793-dbd8863d9567 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.179285 Jun 23 09:26:44.581871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 170/335] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:44 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:45.498325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:45.499717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:45.506318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:45.507149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:45.509045 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:45.509701 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:45.555636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:45.598648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:45.599356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:45.616694 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:45.617889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:45.620896 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:45.643673 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:45.793445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:45.804126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:45.813170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:45.817273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-52bc3b4b-ef4b-43fc-ad7b-5beb0fa5c304 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.322012 Jun 23 09:26:45.819529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 166/336] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:45 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:45.934412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:45.942965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-15532c12-dccb-45a7-9380-5679432f962e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.348945 Jun 23 09:26:45.943557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 171/337] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:45 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:46.837006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:46.838261 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:46.846233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:46.846956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:46.847893 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:46.848479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:46.962770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:46.963558 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:46.970736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:46.975710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:46.976833 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:46.979594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:47.061048 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:47.072622 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:47.074243 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:47.077706 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-feee7f6a-a38b-4b34-8291-2a19002e8eff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.244493 Jun 23 09:26:47.080434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 167/338] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:46 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:47.196607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:47.207037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-68e0da63-f360-4786-b96b-6155d5cbd0ac tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.250054 Jun 23 09:26:47.208467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 172/339] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:46 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:48.098640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:48.099477 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:48.106037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:48.109142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:48.109934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:48.110370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:48.226069 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:48.226676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:48.236649 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:48.237099 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:48.238088 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:48.238677 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:48.383736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:48.410501 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:48.412376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:48.413620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bb4d5f77-d96b-40ff-b30f-b87f8847e7df tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.319106 Jun 23 09:26:48.414163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 168/340] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:48 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:48.611878 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:48.629711 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5bdac9aa-516e-4a04-a51c-d7f61090721b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1502 microversion: 2.1 time: 0.407627 Jun 23 09:26:48.630364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 173/341] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:48 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1502 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:48.942267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-82633e84-1ca8-44b7-8d4f-a74e92531d69 req-1b5ad4a6-f8de-43a2-bc5b-05cf9307d44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1", "name": "network-vif-deleted", "tag": "1af03f42-b0af-4904-b2cd-5c086eec8f36"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:48.960360 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-82633e84-1ca8-44b7-8d4f-a74e92531d69 req-1b5ad4a6-f8de-43a2-bc5b-05cf9307d44c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:48.960889 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-82633e84-1ca8-44b7-8d4f-a74e92531d69 req-1b5ad4a6-f8de-43a2-bc5b-05cf9307d44c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:48.973035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-82633e84-1ca8-44b7-8d4f-a74e92531d69 req-1b5ad4a6-f8de-43a2-bc5b-05cf9307d44c service nova] Creating event network-vif-deleted:1af03f42-b0af-4904-b2cd-5c086eec8f36 for instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 on hv-cinder-84727 Jun 23 09:26:48.979182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-82633e84-1ca8-44b7-8d4f-a74e92531d69 req-1b5ad4a6-f8de-43a2-bc5b-05cf9307d44c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045306 Jun 23 09:26:48.980288 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 169/342] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:49.432461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:49.433078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:49.441201 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:49.441965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:49.443009 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:49.443437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:49.469923 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:49.626292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:49.636338 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:49.638262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:49.639463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c3efcfd5-9f00-48ef-8b2b-3e5d7e7f02ac tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.211069 Jun 23 09:26:49.640168 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 174/343] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:49 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:49.655532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:49.656211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:49.663560 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:49.664192 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:49.664957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:49.665390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:49.699235 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:49.700023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:49.701162 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lazy-loading 'fault' on Instance uuid 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:26:49.783483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:49.791621 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-66f99729-8a41-46a9-877a-be7894ae948a tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1303 microversion: 2.1 time: 0.141495 Jun 23 09:26:49.795870 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 170/344] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:49 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:50.660603 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:50.662157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:50.670329 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:50.670782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:50.671588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:50.672108 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:50.802197 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:50.810900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:50.812036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:50.812508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:50.812920 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:50.813663 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c33155e5-69d2-4bbd-89fd-726d462badec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.157956 Jun 23 09:26:50.814403 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 175/345] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:50 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:50.819487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:50.819940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:50.820848 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:50.821277 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:50.855112 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:50.855598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:50.856054 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lazy-loading 'fault' on Instance uuid 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:26:50.911201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:50.918754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2a84cbc9-56d4-48b6-8501-c73fdcc3f5bf tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1303 microversion: 2.1 time: 0.110952 Jun 23 09:26:50.919381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 171/346] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:50 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:51.834362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:51.834362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:51.844912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:51.845380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:51.846438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:51.846883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:52.017872 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:52.026583 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:52.037096 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:52.038350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-537ab1b8-618e-4804-a546-3f4ac40d6de3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.209805 Jun 23 09:26:52.041035 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 176/347] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:51 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:52.049763 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:52.050606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:52.057355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:52.058034 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:52.059275 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:52.067814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:52.105604 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:52.106059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:52.106514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lazy-loading 'fault' on Instance uuid 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:26:52.152870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:52.171685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ff47b397-5ff8-4177-b29c-d3596f73b15c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 200 len: 1303 microversion: 2.1 time: 0.119456 Jun 23 09:26:52.171685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 177/348] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:52 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:52.184114 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4fd9a00d-8f32-4f0b-86cd-c52c6f464036 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Action: 'create', calling method: .version_select at 0x7f8270ea35e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-476245517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo5p5Q8PSC9cVV9xGOYHNjBgNhXn1NLqAxMsY5UE0xguLVwD5+VZeSUwIc4UaS3GXAEBQfyweCZtrGAJY9FIKCH3kALBKDXn01+tNL4CbPeovQBqj11f536aBN4g4Yp4A=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:52.200990 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-4fd9a00d-8f32-4f0b-86cd-c52c6f464036 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Getting quotas for project 3ee3f1c33377446489b75e9faaa5654b. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:26:52.205931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-4fd9a00d-8f32-4f0b-86cd-c52c6f464036 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Getting quotas for user 65220457c29c46358fee054fb9366406 and project 3ee3f1c33377446489b75e9faaa5654b. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:26:52.313652 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4fd9a00d-8f32-4f0b-86cd-c52c6f464036 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.424045 Jun 23 09:26:52.314289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 172/349] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:26:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:53.056233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:53.056845 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:53.064346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:53.064796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:53.066398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:53.066833 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:53.178784 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:53.179541 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:53.186235 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:53.186820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:53.187542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:53.187982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:53.202140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] HTTP exception thrown: Instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 could not be found. Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Request method failure captured: Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 HTTP/1.1 Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDG28en-JzCpiM07XhW79B4l18DQXK6v7OCaQMhmhgpgvRLzIrxZHgMPvEbDNLw5Tc-vF-uuSUv_7EN5MnHTiI3-eHUiP46KgI_GfP13GL6aagZ3wwfjZrodsRB_SdTaJcNMXjmT-xfdthd7xbl2mgxg0o8-tFfM49257iK148xKh3E Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6a1a64d6d0f241739bb3dad4490182ed Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesActionsTest-377808080 Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:26:53.204142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a1a64d6d0f241739bb3dad4490182ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a1a64d6d0f241739bb3dad4490182ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6a1a64d6d0f241739bb3dad4490182ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6a1a64d6d0f241739bb3dad4490182ed", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesActionsTest-377808080 Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6a1a64d6d0f241739bb3dad4490182ed Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesActionsTest-377808080 Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesActionsTest-377808080-project Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 484c9ed8db294be9aaeb2a7e50afabe0 Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesActionsTest-377808080-project Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 could not be found. Jun 23 09:26:53.212026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1'} Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 could not be found. Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:26:53.212934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 could not be found. Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 could not be found. Jun 23 09:26:53.214359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:26:53.215887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Returning 404 to user: Instance 61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:26:53.216567 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:53.216665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-36ca4f7e-40ba-4bf5-96be-6686ca5f434f tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1" status: 404 len: 111 microversion: 2.1 time: 0.030688 Jun 23 09:26:53.216665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 173/350] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:53 2022] GET /compute/v2.1/servers/61a2c4d3-d4fb-47d6-95fb-b35d3f8eadf1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:26:53.218997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:53.221714 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:53.222898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8f545572-a7b1-4b18-8375-fc7bd28995b1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.170664 Jun 23 09:26:53.223474 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 178/351] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:53 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:53.329858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-239451026", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "networks": [{"uuid": "c0764c8f-72a0-45ca-8ee9-2b6c8b4710bb"}]}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:53.383734 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] validate_networks() for [('c0764c8f-72a0-45ca-8ee9-2b6c8b4710bb', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:26:53.772906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:26:53.773330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:26:53.773803 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:26:53.774212 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:26:53.774860 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:26:53.783755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:53.784205 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:53.785009 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:53.785704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:53.803947 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Getting quotas for project 6a1a64d6d0f241739bb3dad4490182ed. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:26:53.808154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Getting quotas for user 484c9ed8db294be9aaeb2a7e50afabe0 and project 6a1a64d6d0f241739bb3dad4490182ed. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:26:53.819940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:26:53.822218 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:26:54.048219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f5b1932a-3996-4553-9eaa-027af94a2bef tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722802 Jun 23 09:26:54.049480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 174/352] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:26:54.058806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:54.060163 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:54.060388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5c95366f-f278-4af3-8cc6-3e973904ffd3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:54.060767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5c95366f-f278-4af3-8cc6-3e973904ffd3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:54.066321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:54.067277 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:54.071734 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:54.075097 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:54.107743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-20a2c54b-1539-4f46-9c41-435efef48245 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/ips" status: 200 len: 150 microversion: 2.1 time: 0.052880 Jun 23 09:26:54.110079 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 179/353] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:26:54 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:26:54.124506 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5c95366f-f278-4af3-8cc6-3e973904ffd3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:54.134437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5c95366f-f278-4af3-8cc6-3e973904ffd3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1213 microversion: 2.1 time: 0.078843 Jun 23 09:26:54.136384 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 175/354] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:54 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:54.243581 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:54.244668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:54.251988 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:54.252933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:54.254012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:54.258747 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:54.423502 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:54.432379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:54.437779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:54.438693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2470b334-c936-4eac-8e81-a261b6c4521b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.199390 Jun 23 09:26:54.439543 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 180/355] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:54 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:55.155165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-069c1f43-120f-4bf1-9f34-9a0b872ad75e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:55.156441 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-069c1f43-120f-4bf1-9f34-9a0b872ad75e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:55.221290 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-069c1f43-120f-4bf1-9f34-9a0b872ad75e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:55.228186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-069c1f43-120f-4bf1-9f34-9a0b872ad75e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1213 microversion: 2.1 time: 0.076965 Jun 23 09:26:55.228733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 176/356] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:55 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:55.457174 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:55.457917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:55.464571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:55.465059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:55.466533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:55.466992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:55.628537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:55.650369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:55.656037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:55.657733 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a64ecee4-6e15-4926-a980-a791cf1462ee tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.204142 Jun 23 09:26:55.668416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 181/357] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:55 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:56.199724 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "307ce01e-40c0-4660-94f6-53bea8447325"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:56.201934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:56.218499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:56.218977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:56.221280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:56.221280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:56.248767 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:56.249496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:56.275220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:56.277394 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:56.284464 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:56.285245 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:56.371640 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:56.380678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5af48398-5879-43c2-8bb4-fbee39c34498 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1209 microversion: 2.1 time: 0.136474 Jun 23 09:26:56.381290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 182/358] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:56 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:56.707086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:56.707086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:56.707086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:56.707086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:56.708514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:56.708514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:56.826865 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:56.835848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:56.837400 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:56.838565 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4fb3bbe6-8c22-49cb-948c-a5f82568ab32 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.162819 Jun 23 09:26:56.839178 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 183/359] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:56 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:57.401352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:57.401974 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:57.410025 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:57.410541 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:57.411497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:57.415548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:57.479924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:57.487984 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f92f031f-9a40-417a-ad05-ba6d909b81f4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1273 microversion: 2.1 time: 0.093812 Jun 23 09:26:57.488628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 184/360] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:57 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:26:57.860674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:57.861351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:57.869140 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:57.869581 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:57.870377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:57.870810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:57.972487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1e765390-6cbc-4ad5-bbbc-aff4fae23977 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.777575 Jun 23 09:26:57.975874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 177/361] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:26:56 2022] POST /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments => generated 194 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:58.078708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:58.091888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:58.094458 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:58.096882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-24400b70-7a91-406c-aea5-ac0fee68af84 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.241971 Jun 23 09:26:58.098075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 185/362] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:57 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:26:58.335509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-14fe9c43-6ab3-4cce-a9ca-1b93d8f98fe7 req-cc9a7598-aa65-4a9f-b988-66d347df6110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "name": "network-vif-plugged", "status": "completed", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:58.350654 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-14fe9c43-6ab3-4cce-a9ca-1b93d8f98fe7 req-cc9a7598-aa65-4a9f-b988-66d347df6110 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:58.351189 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-14fe9c43-6ab3-4cce-a9ca-1b93d8f98fe7 req-cc9a7598-aa65-4a9f-b988-66d347df6110 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:58.365167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-14fe9c43-6ab3-4cce-a9ca-1b93d8f98fe7 req-cc9a7598-aa65-4a9f-b988-66d347df6110 service nova] Creating event network-vif-plugged:a29b275b-5e50-40ac-a543-defb30d49ca9 for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b on hv-cinder-84727 Jun 23 09:26:58.370503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-14fe9c43-6ab3-4cce-a9ca-1b93d8f98fe7 req-cc9a7598-aa65-4a9f-b988-66d347df6110 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039377 Jun 23 09:26:58.371618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 178/363] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:26:58.504967 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:58.505588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:58.515576 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:58.517056 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:58.517987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:58.518704 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:58.713243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:58.721595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-61b5167c-c59c-4246-a46d-466f678c761c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.220819 Jun 23 09:26:58.722166 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 186/364] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:58 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:59.130594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:59.131549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:59.143488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:59.144207 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:59.145262 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:59.147613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:59.389496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:59.400463 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:59.402110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:59.404233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-44d11b7f-bc01-4682-be8c-30f5e31034fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.284480 Jun 23 09:26:59.405199 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 179/365] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:26:59 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:26:59.738653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:26:59.739239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:26:59.746064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:59.746515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:59.747966 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:59.748409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:59.892692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-b3fd22c8-9919-49c5-840b-d40686d918fd req-c8048719-a5fb-4c19-b655-274a8ddd66e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5585521e-88c3-4e49-bc28-c26be9f82824", "tag": "d8209f4b-dd1e-4751-90ec-e979baeed397"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:26:59.892951 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:26:59.905757 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-b3fd22c8-9919-49c5-840b-d40686d918fd req-c8048719-a5fb-4c19-b655-274a8ddd66e8 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:26:59.909410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-b3fd22c8-9919-49c5-840b-d40686d918fd req-c8048719-a5fb-4c19-b655-274a8ddd66e8 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:26:59.909751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9a3ba22c-a0e8-46af-bb4b-52143a18c9cb tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.172472 Jun 23 09:26:59.909751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 187/366] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:26:59 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:26:59.925903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-b3fd22c8-9919-49c5-840b-d40686d918fd req-c8048719-a5fb-4c19-b655-274a8ddd66e8 service nova] Creating event network-changed:d8209f4b-dd1e-4751-90ec-e979baeed397 for instance 5585521e-88c3-4e49-bc28-c26be9f82824 on hv-cinder-84727 Jun 23 09:26:59.930819 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-b3fd22c8-9919-49c5-840b-d40686d918fd req-c8048719-a5fb-4c19-b655-274a8ddd66e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045380 Jun 23 09:26:59.931535 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 180/367] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:27:00.422883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:00.423519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:00.430153 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:00.430801 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:00.431611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:00.432453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:00.584490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:00.593142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:00.594648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:00.595828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cd2a084b-45e6-49ee-af61-9dea95104ec6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.176888 Jun 23 09:27:00.596379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 188/368] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:00 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:00.924826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:00.925608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:00.932646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:00.933190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:00.933969 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:00.934401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:01.069183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:01.076853 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2e63dd63-5ec4-418d-97b9-12387e21901b tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.156676 Jun 23 09:27:01.077415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 181/369] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:00 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:01.613916 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:01.614533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:01.621271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:01.621951 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:01.623299 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:01.623743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:01.768304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:01.777083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:01.779137 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:01.780418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-146ef635-5413-4daa-abf1-cd8fd0cd8998 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.170451 Jun 23 09:27:01.780971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 189/370] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:01 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:02.095515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:02.097803 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:02.103477 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:02.104018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:02.104874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:02.105403 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:02.240405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:02.248709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b8f2a79d-02df-41c6-af59-43717377f5f8 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.158463 Jun 23 09:27:02.249283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 182/371] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:02 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:02.799107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:02.799720 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:02.806630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:02.807123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:02.807893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:02.808329 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:02.955635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:02.963987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:02.965490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:02.967360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d83c0c7c-b957-42f6-8e3a-7fda376da75d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1808 microversion: 2.20 time: 0.173208 Jun 23 09:27:02.967922 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 190/372] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:02 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:03.266454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:03.267105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:03.273486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:03.280478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:03.280478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:03.280478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:03.414241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:03.423285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b1c85923-e66f-44f3-8077-1757dbfa5951 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.161464 Jun 23 09:27:03.423986 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 183/373] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:03 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:03.986196 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:03.986806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:03.993386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:03.993841 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:03.994607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:03.995083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:03.999089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:04.133389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:04.142317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:04.143850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:04.145001 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-bbab9db7-bcec-4fb3-98fa-76579bdcc200 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1795 microversion: 2.20 time: 0.163650 Jun 23 09:27:04.145555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 191/374] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:03 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:04.441287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:04.441894 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:04.444033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:04.449526 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:04.449969 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:04.451429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:04.451724 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:04.588747 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:04.596214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4e5a58e7-99ec-42c7-b454-459397fec416 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.158849 Jun 23 09:27:04.596996 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 184/375] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:04 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:05.623655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:05.624273 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:05.631608 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:05.632057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:05.632821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:05.633257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:05.763797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:05.771297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-051b9de6-a68e-4007-8651-af8b580ffa5e tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.158258 Jun 23 09:27:05.771858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 192/376] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:05 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:06.339290 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-7128dc40-42f9-4ec8-84a8-7a513feae18e req-7e38aea3-bbf1-4c10-ba86-6abe2be696e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5585521e-88c3-4e49-bc28-c26be9f82824", "name": "network-vif-plugged", "status": "completed", "tag": "d8209f4b-dd1e-4751-90ec-e979baeed397"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:06.344584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=14 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:06.349320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-7128dc40-42f9-4ec8-84a8-7a513feae18e req-7e38aea3-bbf1-4c10-ba86-6abe2be696e1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:06.349760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-7128dc40-42f9-4ec8-84a8-7a513feae18e req-7e38aea3-bbf1-4c10-ba86-6abe2be696e1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:06.360741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-7128dc40-42f9-4ec8-84a8-7a513feae18e req-7e38aea3-bbf1-4c10-ba86-6abe2be696e1 service nova] Creating event network-vif-plugged:d8209f4b-dd1e-4751-90ec-e979baeed397 for instance 5585521e-88c3-4e49-bc28-c26be9f82824 on hv-cinder-84727 Jun 23 09:27:06.365886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-7128dc40-42f9-4ec8-84a8-7a513feae18e req-7e38aea3-bbf1-4c10-ba86-6abe2be696e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 Jun 23 09:27:06.366970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 185/377] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:06.677435 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b72e0bee-0265-4a8b-a4ea-d08510b6e52a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: .version_select at 0x7f8270b2f790>, body: {"keypair": {"name": "tempest-keypair-1376545613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOm+aA5+JJzHZvLzMONw2oVCPg0g4Dhbo7Hh7xo3tU/1+EslshWr5UKyBl+Btf3+TKpvgMnNXlkLwbo4qFx7DdfAnlA3gcBqolZTm0VoxjkmES/zp9wVfEr0KokEbhXAuA=="}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:06.692110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-b72e0bee-0265-4a8b-a4ea-d08510b6e52a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:27:06.695962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-b72e0bee-0265-4a8b-a4ea-d08510b6e52a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:27:06.789499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:06.790192 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:06.797076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:06.797543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:06.798346 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:06.798788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:06.821635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b72e0bee-0265-4a8b-a4ea-d08510b6e52a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147980 Jun 23 09:27:06.822267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 193/378] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:27:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:06.964795 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:06.972684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ca121718-32b7-4f97-92c6-38631f7143b3 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.187797 Jun 23 09:27:06.973253 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 186/379] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:06 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:07.990536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:07.991114 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:07.998328 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:07.998772 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:07.999573 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:08.000005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:08.130370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:08.138754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-249eae6a-9d00-4a06-9471-d67fd2c04fb4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1313 microversion: 2.1 time: 0.152688 Jun 23 09:27:08.139556 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 194/380] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:07 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:09.156161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:09.156773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:09.163388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:09.163839 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:09.164604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:09.165041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:09.267823 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117315711", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "308c25e5-5cce-431f-b4d9-9d80a125cd28"}], "security_groups": [{"name": "tempest-securitygroup--310694582"}], "key_name": "tempest-keypair-1376545613", "user_data": "}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:09.307293 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:09.315217 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a160dd9a-1a27-4973-b5d7-7fec8ec30629 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1497 microversion: 2.1 time: 0.163447 Jun 23 09:27:09.315778 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 187/381] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:09 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:09.385459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] validate_networks() for [('308c25e5-5cce-431f-b4d9-9d80a125cd28', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:27:09.561691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:09.749363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:27:09.749810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:27:09.750281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:27:09.750687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:27:09.751126 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:27:09.759898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:09.760339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:09.761216 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:09.761694 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:09.779023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:27:09.782933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:27:09.793639 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:27:09.796002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:27:09.925785 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [22082432-1463-49c9-841f-51c80d6a782d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 09:27:10.510505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:10.511006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:10.517997 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:10.518444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:10.519235 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:10.522997 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:10.523702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:10.544918 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:27:10.932824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO oslo.messaging._drivers.impl_rabbit [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [22082432-1463-49c9-841f-51c80d6a782d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48702. Jun 23 09:27:11.068105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f4621028-31d3-4350-81b8-edffbf42cfad tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.673113 Jun 23 09:27:11.068105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 195/382] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:27:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 09:27:11.108618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1699ec43-76a0-4884-949c-407a91b5a89d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:11.109497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1699ec43-76a0-4884-949c-407a91b5a89d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:11.161853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1699ec43-76a0-4884-949c-407a91b5a89d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:11.170374 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1699ec43-76a0-4884-949c-407a91b5a89d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1242 microversion: 2.1 time: 0.065658 Jun 23 09:27:11.170957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 196/383] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:11 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:11.191991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f066c235-eb0d-44f7-a7c0-e579ff9e5fd4 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 204 len: 0 microversion: 2.1 time: 0.682039 Jun 23 09:27:11.191991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 188/384] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:27:10 2022] DELETE /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 09:27:11.200352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:11.200992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:11.206972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:11.207417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:11.208236 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:11.208667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:11.336559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:11.344455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2dc8712d-0b5f-40ab-8d0b-4615a26e8364 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1503 microversion: 2.1 time: 0.149703 Jun 23 09:27:11.345028 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 197/385] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:11 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:12.187390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:12.188090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:12.194594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:12.195144 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:12.195914 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:12.196353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:12.259377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:12.266740 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9728b805-6732-42a0-860e-fc6e564c6179 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1246 microversion: 2.1 time: 0.083628 Jun 23 09:27:12.267340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 189/386] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:12 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:12.361747 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:12.362417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:12.368902 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:12.369360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:12.370122 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:12.370972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:12.498979 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:12.506353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e095819f-2a46-4575-9164-507aecf8216c tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1503 microversion: 2.1 time: 0.148695 Jun 23 09:27:12.506972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 198/387] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:12 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:13.287365 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:13.288563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:13.304716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:13.306655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:13.306655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:13.306655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:13.389632 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:13.397769 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-92b3ecdf-ddba-4146-a721-57a22bb36953 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1238 microversion: 2.1 time: 0.115272 Jun 23 09:27:13.398435 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 190/388] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:13 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:13.525422 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:13.525800 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:13.532842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:13.533294 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:13.534100 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:13.534566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:13.668791 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:13.683032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7e17f5f6-c61c-476c-9209-dd4face0de26 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1503 microversion: 2.1 time: 0.157589 Jun 23 09:27:13.683032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 199/389] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:13 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:13.762576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-abfdb12a-080b-4c0e-ab0a-fb5b31535666 req-8fec9a74-423e-4f83-bcc5-d0eb2888ba3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5585521e-88c3-4e49-bc28-c26be9f82824", "name": "network-vif-deleted", "tag": "d8209f4b-dd1e-4751-90ec-e979baeed397"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:13.770573 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-abfdb12a-080b-4c0e-ab0a-fb5b31535666 req-8fec9a74-423e-4f83-bcc5-d0eb2888ba3d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:13.771050 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-abfdb12a-080b-4c0e-ab0a-fb5b31535666 req-8fec9a74-423e-4f83-bcc5-d0eb2888ba3d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:13.783453 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-abfdb12a-080b-4c0e-ab0a-fb5b31535666 req-8fec9a74-423e-4f83-bcc5-d0eb2888ba3d service nova] Creating event network-vif-deleted:d8209f4b-dd1e-4751-90ec-e979baeed397 for instance 5585521e-88c3-4e49-bc28-c26be9f82824 on hv-cinder-84727 Jun 23 09:27:13.788359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-abfdb12a-080b-4c0e-ab0a-fb5b31535666 req-8fec9a74-423e-4f83-bcc5-d0eb2888ba3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029483 Jun 23 09:27:13.788943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 191/390] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:14.416689 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:14.417218 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:14.423770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:14.424219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:14.424979 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:14.425415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:14.488399 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:14.496118 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0e5ff45c-721a-4456-ba8f-2a416c42d02b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1294 microversion: 2.1 time: 0.083520 Jun 23 09:27:14.496788 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 200/391] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:14 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:14.696620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:14.697244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:14.699200 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:14.705686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:14.705686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:14.705908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:14.706271 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:14.737735 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:14.738179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:14.738619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lazy-loading 'fault' on Instance uuid 5585521e-88c3-4e49-bc28-c26be9f82824 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:27:14.780249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c9ed8db294be9aaeb2a7e50afabe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1a64d6d0f241739bb3dad4490182ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:14.787908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-17da9240-99f7-444b-a2f8-98f6412be685 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 200 len: 1303 microversion: 2.1 time: 0.096076 Jun 23 09:27:14.788480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 192/392] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:14 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:14.905457 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-94222629", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-476245517", "security_groups": [{"name": "tempest-secgroup-smoke-1463312535"}], "networks": [{"uuid": "41d8d680-ae9a-4d55-be37-805921d1b1ec"}], "block_device_mapping_v2": [{"uuid": "a39df75e-9df0-4190-a528-f17b7d4b3732", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:15.023617 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] validate_networks() for [('41d8d680-ae9a-4d55-be37-805921d1b1ec', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:27:15.426698 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:27:15.427158 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:27:15.427633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:27:15.428037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:27:15.428443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:27:15.437630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:15.438065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:15.438854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:15.439387 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:15.457181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Getting quotas for project 3ee3f1c33377446489b75e9faaa5654b. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:27:15.461335 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Getting quotas for user 65220457c29c46358fee054fb9366406 and project 3ee3f1c33377446489b75e9faaa5654b. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:27:15.512910 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:15.513611 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:15.520432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:15.521950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:15.522828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:15.523525 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:15.553359 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:27:15.553359 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a39df75e-9df0-4190-a528-f17b7d4b3732',volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:27:15.611435 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:15.619038 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-40afcb04-8b61-4545-ab93-70dd25081b53 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1300 microversion: 2.1 time: 0.110379 Jun 23 09:27:15.622880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 193/393] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:15 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:15.804403 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:15.805083 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] [instance: 5585521e-88c3-4e49-bc28-c26be9f82824] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:15.812007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:15.812457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:15.813222 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:15.813695 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:15.826770 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] HTTP exception thrown: Instance 5585521e-88c3-4e49-bc28-c26be9f82824 could not be found. Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Request method failure captured: Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 HTTP/1.1 Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDG28en-JzCpiM07XhW79B4l18DQXK6v7OCaQMhmhgpgvRLzIrxZHgMPvEbDNLw5Tc-vF-uuSUv_7EN5MnHTiI3-eHUiP46KgI_GfP13GL6aagZ3wwfjZrodsRB_SdTaJcNMXjmT-xfdthd7xbl2mgxg0o8-tFfM49257iK148xKh3E Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6a1a64d6d0f241739bb3dad4490182ed Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesActionsTest-377808080 Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:27:15.828410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a1a64d6d0f241739bb3dad4490182ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a1a64d6d0f241739bb3dad4490182ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6a1a64d6d0f241739bb3dad4490182ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6a1a64d6d0f241739bb3dad4490182ed", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesActionsTest-377808080 Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6a1a64d6d0f241739bb3dad4490182ed Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesActionsTest-377808080 Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesActionsTest-377808080-project Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 484c9ed8db294be9aaeb2a7e50afabe0 Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesActionsTest-377808080-project Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 5585521e-88c3-4e49-bc28-c26be9f82824 could not be found. Jun 23 09:27:15.829911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '5585521e-88c3-4e49-bc28-c26be9f82824'} Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5585521e-88c3-4e49-bc28-c26be9f82824 could not be found. Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:27:15.830887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5585521e-88c3-4e49-bc28-c26be9f82824 could not be found. Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5585521e-88c3-4e49-bc28-c26be9f82824 could not be found. Jun 23 09:27:15.832686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:15.834082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] Returning 404 to user: Instance 5585521e-88c3-4e49-bc28-c26be9f82824 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:27:15.834082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6db8dd66-25e3-4e39-8b16-744b78a99b10 tempest-VolumesActionsTest-377808080 tempest-VolumesActionsTest-377808080-project] 10.222.0.52 "GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824" status: 404 len: 111 microversion: 2.1 time: 0.029255 Jun 23 09:27:15.834082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 194/394] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:15 2022] GET /compute/v2.1/servers/5585521e-88c3-4e49-bc28-c26be9f82824 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:27:16.141452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-892f6382-0254-403e-ba5f-724201c628c6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.240639 Jun 23 09:27:16.151059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 201/395] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:27:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:27:16.153912 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a4e9c709-57c7-432d-be17-4a694eb0a753 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:16.154770 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a4e9c709-57c7-432d-be17-4a694eb0a753 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:16.227820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a4e9c709-57c7-432d-be17-4a694eb0a753 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:16.237721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a4e9c709-57c7-432d-be17-4a694eb0a753 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1086 microversion: 2.1 time: 0.086890 Jun 23 09:27:16.237721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 195/396] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:16 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1086 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:16.638066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:16.638066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:16.643176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:16.647360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:16.648250 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:16.648734 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:16.830719 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:16.843622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c47d26cb-b615-489b-8f0c-26595971677a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.210806 Jun 23 09:27:16.848532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 202/397] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:16 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:17.133115 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-61305fe6-35cf-474e-a62c-ad28bdaf6613 req-6f9a8daa-2578-4dbc-b11a-0f3f12be5b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4d3349-a28c-4fb0-8cb5-12cad9123599", "tag": "e1a628b3-9901-4e94-8ad7-07ac85c70f71"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:17.146578 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-61305fe6-35cf-474e-a62c-ad28bdaf6613 req-6f9a8daa-2578-4dbc-b11a-0f3f12be5b62 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:17.147090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-61305fe6-35cf-474e-a62c-ad28bdaf6613 req-6f9a8daa-2578-4dbc-b11a-0f3f12be5b62 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:17.178499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-61305fe6-35cf-474e-a62c-ad28bdaf6613 req-6f9a8daa-2578-4dbc-b11a-0f3f12be5b62 service nova] Creating event network-changed:e1a628b3-9901-4e94-8ad7-07ac85c70f71 for instance da4d3349-a28c-4fb0-8cb5-12cad9123599 on hv-cinder-84727 Jun 23 09:27:17.185808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-61305fe6-35cf-474e-a62c-ad28bdaf6613 req-6f9a8daa-2578-4dbc-b11a-0f3f12be5b62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065263 Jun 23 09:27:17.186539 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 196/398] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:27:17.252874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f2339a00-bb38-4e12-b76d-f4ad1b518c27 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:17.254248 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f2339a00-bb38-4e12-b76d-f4ad1b518c27 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:17.311944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f2339a00-bb38-4e12-b76d-f4ad1b518c27 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:17.322139 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f2339a00-bb38-4e12-b76d-f4ad1b518c27 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1086 microversion: 2.1 time: 0.070640 Jun 23 09:27:17.322139 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 203/399] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:17 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1086 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:17.861577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:17.862287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:17.868475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:17.868863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:17.869613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:17.870050 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:17.998980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:18.006373 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3f5d5462-2ba5-426f-8365-1b1fe084952c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.149478 Jun 23 09:27:18.006950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 197/400] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:17 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:18.335509 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:18.336120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:18.343117 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:18.343566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:18.344326 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:18.344762 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:18.410653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:18.417961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a2da69dc-a4a2-4b20-b905-92011a20badb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1136 microversion: 2.1 time: 0.086305 Jun 23 09:27:18.418512 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 204/401] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:18 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:18.874265 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:18.875524 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:18.882075 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:18.882528 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:18.883326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:18.883768 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:19.023755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:19.024403 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:19.030342 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:19.030797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:19.031591 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:19.032031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:19.157612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:19.165226 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d4aec78e-8de6-43d3-a8cd-ea389b0ec24c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.145330 Jun 23 09:27:19.165812 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 205/402] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:19 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:19.434339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:19.434989 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:19.441984 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:19.442423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:19.443203 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:19.443634 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:19.504000 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:19.511399 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-759350b9-db2a-4911-ac44-ff53981198e3 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1136 microversion: 2.1 time: 0.081206 Jun 23 09:27:19.511954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 206/403] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:19 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1136 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:20.182597 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:20.183232 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:20.189822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:20.190268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:20.191065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:20.191498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:20.323147 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:20.331580 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c0f39b5b-173e-4fb0-92f7-dfc85ff7bbd0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.152157 Jun 23 09:27:20.333280 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 207/404] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:20 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:20.527233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:20.528037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:20.534719 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:20.535190 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:20.535951 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:20.543202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:20.601647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:20.609434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-91434145-ae83-45fd-8c33-bf31c8f0bbdf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1128 microversion: 2.1 time: 0.086042 Jun 23 09:27:20.611782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 208/405] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:20 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1128 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:21.072089 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d842e866-fd04-4918-ad66-7e2c56445670 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.202120 Jun 23 09:27:21.072759 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 198/406] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:27:18 2022] POST /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments => generated 194 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:21.348433 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:21.349044 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:21.355423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:21.355894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:21.357268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:21.357702 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:21.490755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:21.499014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-211bff96-3ede-43f2-8f32-344cb18e5474 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.154444 Jun 23 09:27:21.499588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 209/407] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:21 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:21.627346 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:21.628354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:21.643555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:21.644230 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:21.645438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:21.645438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:21.716495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:21.724239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d182591d-d950-4140-82de-bbaaeb4cb47e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1184 microversion: 2.1 time: 0.101536 Jun 23 09:27:21.725118 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 199/408] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:21 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:22.514966 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:22.515591 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:22.524775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:22.525265 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:22.525944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:22.526390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:22.709220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:22.717555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-76e93263-5d91-401b-b89c-9ab20c60e720 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.206674 Jun 23 09:27:22.727044 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 210/409] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:22 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:22.741956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:22.742562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:22.750059 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:22.750733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:22.751963 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:22.752581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:22.834106 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:22.859041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ba0a72e6-0a57-4b55-9a5a-4b1ef1e33ee5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1202 microversion: 2.1 time: 0.112722 Jun 23 09:27:22.859041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 200/410] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:22 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:23.734448 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:23.741491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:23.742876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:23.743753 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:23.744704 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:23.745300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:23.869841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:23.870456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:23.882841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:23.888399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:23.890020 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:23.891037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:23.894035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:23.899701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9ea163f4-9e6f-42d8-bd9d-24ab1e3df709 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.169599 Jun 23 09:27:23.901257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 211/411] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:23 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:24.089741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:24.100414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-01df7ee8-0d6b-4ae7-b20d-f420242a1333 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.235003 Jun 23 09:27:24.101288 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 201/412] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:23 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:24.580256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-32151b7b-9e67-4043-96ef-2ab0be1ffbe5 req-ef9c021e-7726-4ed1-8090-03f4a8218a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:24.606804 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-32151b7b-9e67-4043-96ef-2ab0be1ffbe5 req-ef9c021e-7726-4ed1-8090-03f4a8218a93 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:24.607528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-32151b7b-9e67-4043-96ef-2ab0be1ffbe5 req-ef9c021e-7726-4ed1-8090-03f4a8218a93 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:24.621868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:24.639740 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-32151b7b-9e67-4043-96ef-2ab0be1ffbe5 req-ef9c021e-7726-4ed1-8090-03f4a8218a93 service nova] Creating event network-changed:866d3ed7-aceb-4e8d-a61f-b4881b214198 for instance 1c02a829-249f-434a-8551-deca0e564d14 on hv-cinder-84727 Jun 23 09:27:24.656654 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-32151b7b-9e67-4043-96ef-2ab0be1ffbe5 req-ef9c021e-7726-4ed1-8090-03f4a8218a93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080144 Jun 23 09:27:24.657581 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 212/413] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:27:24.919862 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:24.921824 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:24.930767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:24.931918 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:24.933158 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:24.933856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:25.119927 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:25.124817 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:25.134656 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:25.139653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:25.140943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:25.141628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:25.148044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:25.157899 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-31b4d82d-b6a4-4a6b-9ec1-823f4e5b1e50 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.243273 Jun 23 09:27:25.158505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 202/414] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:24 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:25.301189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:25.309216 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b1ed0350-c42b-41ee-bd20-563302bcb482 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.195078 Jun 23 09:27:25.309913 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 213/415] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:25 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:26.176264 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:26.176879 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:26.183181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:26.183965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:26.185305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:26.185864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:26.237854 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:26.327903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:26.330133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:26.337004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:26.340929 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:26.341120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:26.341585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:26.342457 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:26.343021 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:26.351915 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5d10f7da-5ec3-41e7-9f60-a21791aa2bdb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.180071 Jun 23 09:27:26.362354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 203/416] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:26 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:26.514985 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:26.523380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-05cf6b02-6cc7-4678-895c-a5ffbc926266 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.200972 Jun 23 09:27:26.525249 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 214/417] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:26 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:26.563325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-8d312026-3484-4995-915e-944a0786ead7 req-2c2dc551-62f6-4f45-bbe8-b7e571f356c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4d3349-a28c-4fb0-8cb5-12cad9123599", "name": "network-vif-plugged", "status": "completed", "tag": "e1a628b3-9901-4e94-8ad7-07ac85c70f71"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:26.578939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-8d312026-3484-4995-915e-944a0786ead7 req-2c2dc551-62f6-4f45-bbe8-b7e571f356c7 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:26.579385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-8d312026-3484-4995-915e-944a0786ead7 req-2c2dc551-62f6-4f45-bbe8-b7e571f356c7 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:26.591244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-8d312026-3484-4995-915e-944a0786ead7 req-2c2dc551-62f6-4f45-bbe8-b7e571f356c7 service nova] Creating event network-vif-plugged:e1a628b3-9901-4e94-8ad7-07ac85c70f71 for instance da4d3349-a28c-4fb0-8cb5-12cad9123599 on hv-cinder-84727 Jun 23 09:27:26.596344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-8d312026-3484-4995-915e-944a0786ead7 req-2c2dc551-62f6-4f45-bbe8-b7e571f356c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036638 Jun 23 09:27:26.597040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 204/418] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:27.369693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:27.370868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:27.373895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=20 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:27.379935 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:27.380717 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:27.381672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:27.382118 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:27.542141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:27.545158 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:27.548754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:27.566729 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-422c8024-80cb-4fc3-8f22-afc57704ba56 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.194897 Jun 23 09:27:27.567206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:27.567654 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:27.568424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:27.568855 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:27.573282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:27.573792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 215/419] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:27 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:27.754237 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:27.763857 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3eacb981-2303-44e4-a819-41aa54981279 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.225864 Jun 23 09:27:27.765125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 205/420] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:27 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:28.580570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:28.581179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:28.587171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:28.587640 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:28.588369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:28.588804 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:28.769460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:28.788177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:28.789480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:28.802179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b7cce4d6-f481-4f50-ae5a-d6c65dc0e002 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1367 microversion: 2.1 time: 0.225534 Jun 23 09:27:28.802756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 216/421] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:28 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:28.807444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:28.807901 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:28.808684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:28.809694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:29.014161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:29.025691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b534f2b8-0a0c-4b21-9872-a32e04970b00 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.248618 Jun 23 09:27:29.026285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 206/422] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:28 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:29.819404 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:29.820756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:29.828234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:29.829022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:29.829793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:29.830228 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:29.977830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:29.990005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-72dd18d5-1d45-451f-a758-cd4d040a57fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1557 microversion: 2.1 time: 0.174383 Jun 23 09:27:29.990849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 217/423] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:29 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:30.006274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:30.007465 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:30.015116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:30.015960 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:30.016966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:30.017627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:30.044872 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:30.045479 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:30.054724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:30.055299 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:30.056122 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:30.056563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:30.108606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-dbf38281-8c8f-447a-b9c6-b39b680f0b5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106191 Jun 23 09:27:30.115073 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 207/424] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:27:30 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:30.245754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:30.259515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6f7035c7-741d-461d-b7de-5e73b4d4e64a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.218939 Jun 23 09:27:30.260500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 218/425] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:30 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:30.899182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:30.900377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:30.915614 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:30.916161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:30.917031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:30.917542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:30.944610 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'flavor' on Instance uuid 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:27:31.276920 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:31.279031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:31.287571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:31.288481 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:31.289999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:31.290572 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:31.454032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ce3a00fa-f4c0-49e2-af15-6254c2afba62 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/action" status: 200 len: 32 microversion: 2.1 time: 0.560965 Jun 23 09:27:31.467596 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:31.474813 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 208/426] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:27:30 2022] POST /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/action => generated 32 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:27:31.491110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6aba5689-52a7-44f1-a2d8-e89609a4f62c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1270 microversion: 2.1 time: 0.205537 Jun 23 09:27:31.491407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:31.491407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:31.491622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 219/427] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:31 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:31.493765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:31.494537 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:31.495461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:31.496145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:31.581746 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-cc1a92d3-a16f-4e8f-8eb8-429e397df76a req-7876f93b-6fbf-4b2b-a2a9-1a07031d27ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4d3349-a28c-4fb0-8cb5-12cad9123599", "tag": "e1a628b3-9901-4e94-8ad7-07ac85c70f71"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:31.599020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-cc1a92d3-a16f-4e8f-8eb8-429e397df76a req-7876f93b-6fbf-4b2b-a2a9-1a07031d27ed service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:31.599020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-cc1a92d3-a16f-4e8f-8eb8-429e397df76a req-7876f93b-6fbf-4b2b-a2a9-1a07031d27ed service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:31.606810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-cc1a92d3-a16f-4e8f-8eb8-429e397df76a req-7876f93b-6fbf-4b2b-a2a9-1a07031d27ed service nova] Creating event network-changed:e1a628b3-9901-4e94-8ad7-07ac85c70f71 for instance da4d3349-a28c-4fb0-8cb5-12cad9123599 on hv-cinder-84727 Jun 23 09:27:31.612665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-cc1a92d3-a16f-4e8f-8eb8-429e397df76a req-7876f93b-6fbf-4b2b-a2a9-1a07031d27ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035127 Jun 23 09:27:31.614047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 220/428] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:27:31.745428 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:31.754902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a7d89f63-48e5-408d-8e05-49c4d93421fe tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.278309 Jun 23 09:27:31.755677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 209/429] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:31 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:32.498018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:32.502224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:32.520274 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:32.521271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:32.522768 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:32.523301 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:32.746125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:32.759569 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-dd71e12c-cb9e-47fd-a2ef-6c2fab58a695 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.267738 Jun 23 09:27:32.760269 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 221/430] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:32 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:32.778677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:32.779299 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:32.791070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:32.792698 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:32.794033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:32.797053 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:32.963499 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:32.972676 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-257e1127-3dff-4433-a447-325d41fc3cb7 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.198032 Jun 23 09:27:32.983351 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 210/431] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:32 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:33.783869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:33.785434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:33.795231 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:33.796094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:33.798817 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:33.799632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:33.982259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:33.992508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8ca67944-5ad1-4d7f-9639-331da27f9ddd tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.215402 Jun 23 09:27:33.993700 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 222/432] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:33 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:33.994708 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:33.995740 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:34.007217 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:34.008310 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:34.009500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:34.010275 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:34.167846 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:34.177126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b4ecffd7-9ca0-4f3b-940d-dd10d9ae1275 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.190343 Jun 23 09:27:34.178434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 211/433] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:33 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:35.009524 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:35.010165 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:35.017434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:35.017898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:35.018670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:35.019249 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:35.163152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:35.171870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2d9a046e-3822-4d75-a5d7-4ae292cbecbb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.166097 Jun 23 09:27:35.172744 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 223/434] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:35 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:35.195042 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:35.195659 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:35.205022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:35.205544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:35.206408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:35.206851 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:35.342434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:35.350658 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d8a765ad-329d-463a-a3f2-baad28326dcd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.159642 Jun 23 09:27:35.354948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 212/435] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:35 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:36.189593 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:36.191433 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:36.198749 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:36.199339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:36.200862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:36.201496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:36.352444 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:36.361879 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-42bd1649-84d3-47bd-b9a3-6d6ac72e8805 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.176204 Jun 23 09:27:36.362452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 224/436] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:36 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:36.369716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:36.370471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:36.377634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:36.378363 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:36.379507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:36.380255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:36.525682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:36.534863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5983ee36-9505-4166-b6b1-a82bcc843b6a tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.169599 Jun 23 09:27:36.545273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 213/437] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:36 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:37.378612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:37.379333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:37.386025 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:37.386477 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:37.387797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:37.388240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:37.534897 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:37.543004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-00cc1a0b-f9b1-499c-bcf4-9a213b1b0bd9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.168050 Jun 23 09:27:37.543988 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 225/438] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:37 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:37.553265 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:37.553958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:37.561751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:37.562438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:37.563320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:37.563756 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:37.706678 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:37.714732 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9dbfae39-96e7-419b-bfd0-c2e18d665a91 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.165622 Jun 23 09:27:37.715358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 214/439] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:37 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:38.561742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:38.562346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:38.568782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:38.569229 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:38.569984 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:38.570421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:38.700348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:38.708232 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6a242aca-7b74-4626-be85-50d8fdde2923 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.150251 Jun 23 09:27:38.708795 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 226/440] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:38 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:38.731718 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:38.732264 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:38.739309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:38.739762 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:38.740519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:38.740964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:38.885365 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:38.893741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-797e1748-db5e-4bdf-b2a0-fa2ac97dfed6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.165964 Jun 23 09:27:38.894311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 215/441] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:38 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:39.725379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:39.726018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:39.728467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:39.733181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:39.733630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:39.734625 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:39.738890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:39.863834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:39.871066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-61da49ea-01bc-4561-ba0d-d855e88afcaf tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.149515 Jun 23 09:27:39.872144 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 227/442] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:39 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:39.910748 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:39.911379 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:39.917806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:39.918275 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:39.919063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:39.919498 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:40.050803 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:40.058788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7a1645eb-41b5-4021-ae64-db572f5b6016 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.151854 Jun 23 09:27:40.059385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 216/443] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:39 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:40.888445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:40.889005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:40.895731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:40.900087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:40.900087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:40.900087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:41.030335 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:41.037831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-10c3ba1a-f2f5-4c75-bd14-5d7fa71c2ae5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.153711 Jun 23 09:27:41.038394 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 228/444] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:40 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:41.076756 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:41.081051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:41.087772 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:41.088221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:41.088998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:41.089431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:41.224056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:41.232715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f38a21eb-041b-4aa4-b2a5-33a4d8ee8ee8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.160715 Jun 23 09:27:41.233401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 217/445] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:41 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:42.053836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:42.054455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:42.061523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:42.061970 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:42.062730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:42.063194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:42.196296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:42.205532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d9c242fa-d338-40c1-a5d6-f4abb1aa9e67 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.155509 Jun 23 09:27:42.206114 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 229/446] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:42 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:42.252572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:42.253125 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:42.259574 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:42.260017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:42.260768 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:42.261198 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:42.395827 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:42.404791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d94e068a-419d-45e7-ace2-dd0882a9d02e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.156017 Jun 23 09:27:42.409818 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 218/447] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:42 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:42.689104 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-dabcba49-d9a8-41a0-af66-b38337384b35 req-8fca2aed-6783-469d-be78-da7de45eb7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "name": "network-vif-plugged", "status": "completed", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:42.697236 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-dabcba49-d9a8-41a0-af66-b38337384b35 req-8fca2aed-6783-469d-be78-da7de45eb7cc service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:42.697658 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-dabcba49-d9a8-41a0-af66-b38337384b35 req-8fca2aed-6783-469d-be78-da7de45eb7cc service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:42.701437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:42.708450 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-dabcba49-d9a8-41a0-af66-b38337384b35 req-8fca2aed-6783-469d-be78-da7de45eb7cc service nova] Creating event network-vif-plugged:866d3ed7-aceb-4e8d-a61f-b4881b214198 for instance 1c02a829-249f-434a-8551-deca0e564d14 on hv-cinder-84727 Jun 23 09:27:42.713857 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-dabcba49-d9a8-41a0-af66-b38337384b35 req-8fca2aed-6783-469d-be78-da7de45eb7cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028353 Jun 23 09:27:42.714425 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 230/448] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:27:43.229764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:43.230383 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:43.236677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:43.237161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:43.237932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:43.238368 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:43.367898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:43.375468 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-51907e5c-3e1b-4a66-9527-c4b9ec9c4947 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.149639 Jun 23 09:27:43.376037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 219/449] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:43 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:43.422386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:43.423118 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:43.429942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:43.430206 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:43.431659 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:43.431659 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:43.578574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:43.586491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-55f45c58-a0b9-4302-b952-192d255c7d51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.168679 Jun 23 09:27:43.587079 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 231/450] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:43 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:44.392598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:44.393208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:44.399691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:44.400133 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:44.400886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:44.401315 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:44.405416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:44.553922 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:44.562212 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-64ff0914-8bae-4a0d-a042-76b40c9389eb tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1258 microversion: 2.1 time: 0.173521 Jun 23 09:27:44.562787 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 220/451] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:44 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:44.603112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:44.607753 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:44.612103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:44.612564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:44.613335 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:44.613769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:44.749245 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:44.758075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a3086502-8a74-4a0f-8e3f-ce605476ddb6 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.158803 Jun 23 09:27:44.758636 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 232/452] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:44 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:45.425764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:45.426274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:45.432789 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.433230 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.434083 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.434511 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.468271 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-116be8fc-3636-4afd-a28e-3bbe9bb60c5a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments/1ec4dfac-0212-4b49-a26e-c12673c978a5" status: 200 len: 194 microversion: 2.20 time: 0.046779 Jun 23 09:27:45.468857 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 221/453] 10.222.0.52 () {60 vars in 1453 bytes} [Thu Jun 23 09:27:45 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments/1ec4dfac-0212-4b49-a26e-c12673c978a5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:27:45.536445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:45.537286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:45.546176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.546879 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.547677 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.548110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.579325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:45.582280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:45.586186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.586636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.587429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.587864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.682300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lazy-loading 'services' on Instance uuid bd6f6f87-f812-4fe4-98a4-86bab5a8d39b {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:27:45.735568 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:45.745720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f7101255-a68e-430b-94f3-51a98201172f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1442 microversion: 2.1 time: 0.170131 Jun 23 09:27:45.750948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 222/454] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:45 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1442 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:45.766004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:45.766938 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:45.776828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.777344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.778351 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.778787 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.913118 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:45.920906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-74fb90de-e866-46fd-9ff3-2ef7f556273b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1442 microversion: 2.1 time: 0.159944 Jun 23 09:27:45.921466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 223/455] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:45 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:45.925939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:45.926544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:45.939543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.939994 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:45.940770 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:45.941470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:46.024087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-50bfc084-4f85-46e9-8500-fb104c38d92a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments/1ec4dfac-0212-4b49-a26e-c12673c978a5" status: 202 len: 0 microversion: 2.20 time: 0.491379 Jun 23 09:27:46.041733 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 233/456] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Jun 23 09:27:45 2022] DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments/1ec4dfac-0212-4b49-a26e-c12673c978a5 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:27:46.051456 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:46.053227 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:46.063463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:46.064739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:46.065710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:46.066311 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:46.092458 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:46.100778 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-da41c1b0-4b73-45a4-b91b-2707a37864c1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056442 Jun 23 09:27:46.101265 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-89e6f19b-13b2-43a4-be4a-829034fb4012 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.178826 Jun 23 09:27:46.101426 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 234/457] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jun 23 09:27:46 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:27:46.101824 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 224/458] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:45 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:47.113176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:47.114160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:47.118794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:47.119646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:47.120777 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:47.121419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:47.122360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:47.122793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:47.124288 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=70 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:47.128967 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:47.129426 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:47.130365 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:47.130801 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:47.160312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-dd67dac2-2508-42f4-b4dd-12e97d5272ff tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051353 Jun 23 09:27:47.161099 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 235/459] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jun 23 09:27:47 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:27:47.260018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:47.268729 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-594764ec-8d18-4c92-892e-9f72fd491eec tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.153682 Jun 23 09:27:47.269289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 225/460] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:47 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:47.863135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1830033653", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:47.914595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] validate_networks() for None {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:27:48.176335 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:48.181419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:48.183518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.184531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.185354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.185855 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.214739 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2d2a211d-c4c6-4c81-8cc1-0d1adbaabaeb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046577 Jun 23 09:27:48.215339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 226/461] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jun 23 09:27:48 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:48.273830 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:48.274321 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:48.280512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.280967 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.281931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.282370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.307448 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:27:48.308468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:27:48.309769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:27:48.310197 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:27:48.310675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:27:48.311669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:27:48.319848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.320374 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.321223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.321724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.340334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Getting quotas for project e0a012cfeede49989fda04fdd2ba45ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:27:48.344519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Getting quotas for user 72001a6a6daf4840a2c0133e25597698 and project e0a012cfeede49989fda04fdd2ba45ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:27:48.356529 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:27:48.358974 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:27:48.548937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b1926fab-d5ad-47b4-9393-61b63612a2a7 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690547 Jun 23 09:27:48.549863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 236/462] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 09:27:48.554527 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:48.555605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:48.562629 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.563015 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.563973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.564912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.717568 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-edece9ec-1693-41a1-8d9a-831355609e77 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 204 len: 0 microversion: 2.20 time: 0.447209 Jun 23 09:27:48.724850 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 227/463] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jun 23 09:27:48 2022] DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 09:27:48.725518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1d3ef660-5615-4fdd-a8a0-b5a13176bd18 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:48.726400 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1d3ef660-5615-4fdd-a8a0-b5a13176bd18 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:48.752116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:48.771063 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2b83cf4b-060b-4c65-8743-a9d723eecb51 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.219976 Jun 23 09:27:48.771638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 237/464] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:48 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:48.786437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-bd084663-e0b7-4fcd-9d80-76a38d9e364b req-cf7aefde-bf49-46f7-a710-000cd786b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:48.794907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-bd084663-e0b7-4fcd-9d80-76a38d9e364b req-cf7aefde-bf49-46f7-a710-000cd786b1ab service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.795624 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-bd084663-e0b7-4fcd-9d80-76a38d9e364b req-cf7aefde-bf49-46f7-a710-000cd786b1ab service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.800929 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1d3ef660-5615-4fdd-a8a0-b5a13176bd18 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:48.808557 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1d3ef660-5615-4fdd-a8a0-b5a13176bd18 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1215 microversion: 2.1 time: 0.087748 Jun 23 09:27:48.810709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 228/465] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:48 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:48.810881 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-bd084663-e0b7-4fcd-9d80-76a38d9e364b req-cf7aefde-bf49-46f7-a710-000cd786b1ab service nova] Creating event network-changed:866d3ed7-aceb-4e8d-a61f-b4881b214198 for instance 1c02a829-249f-434a-8551-deca0e564d14 on hv-cinder-84727 Jun 23 09:27:48.816209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-bd084663-e0b7-4fcd-9d80-76a38d9e364b req-cf7aefde-bf49-46f7-a710-000cd786b1ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043404 Jun 23 09:27:48.817010 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:48.817947 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:48.820208 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 238/466] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:48.826061 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.826549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.827370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:48.827812 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:48.969261 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:48.977271 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:48.978778 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:48.980116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0f62384a-1372-4690-88d9-20a06e80e5ea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.168244 Jun 23 09:27:48.980705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 229/467] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:48 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:49.788445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:49.789135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:49.796161 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:49.796611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:49.797452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:49.797916 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:49.826064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3e959c11-ea54-4f50-8542-85a91f538802 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:49.826682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3e959c11-ea54-4f50-8542-85a91f538802 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:49.882634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3e959c11-ea54-4f50-8542-85a91f538802 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:49.890208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3e959c11-ea54-4f50-8542-85a91f538802 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1215 microversion: 2.1 time: 0.068485 Jun 23 09:27:49.890786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 230/468] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:49 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:49.937986 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:49.945960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5bbf0623-7dba-4861-9f2b-e2280e484718 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.162222 Jun 23 09:27:49.946538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 239/469] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:49 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:49.998044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:49.998554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:50.008546 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:50.008892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:50.009674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:50.010135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:50.137585 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:50.145543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:50.147154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:50.148316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0fee4b39-bb89-493d-aa17-49a66628f695 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.154780 Jun 23 09:27:50.148876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 231/470] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:49 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:50.907747 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:50.908467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:50.915540 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:50.916629 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:50.917674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:50.918255 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:50.963376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:50.964693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:50.972049 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:50.972755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:50.973823 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:50.974412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:50.987127 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:50.994808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ac090e80-59dc-4a4f-a49c-6220f300d453 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1211 microversion: 2.1 time: 0.090940 Jun 23 09:27:50.995482 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 240/471] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:50 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:51.165644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:51.166258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:51.172395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:51.172847 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:51.173843 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:51.174283 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:51.212799 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:51.221980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0bec6649-530d-42c7-8a7a-22b36626778d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.262662 Jun 23 09:27:51.229862 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 232/472] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:50 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:51.309637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:51.317518 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:51.319049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:51.320191 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-adaaf84a-fa1d-47b7-a885-5e343c341ba5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1723 microversion: 2.20 time: 0.158522 Jun 23 09:27:51.320748 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 241/473] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:51 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:51.894785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-ed1c6e67-6afc-4963-b101-aa9f758ef322 req-d2d27741-2020-4c14-a048-0504b0380d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6f6f87-f812-4fe4-98a4-86bab5a8d39b", "name": "network-vif-deleted", "tag": "a29b275b-5e50-40ac-a543-defb30d49ca9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:51.904048 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-ed1c6e67-6afc-4963-b101-aa9f758ef322 req-d2d27741-2020-4c14-a048-0504b0380d68 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:51.904715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-ed1c6e67-6afc-4963-b101-aa9f758ef322 req-d2d27741-2020-4c14-a048-0504b0380d68 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:51.916743 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-ed1c6e67-6afc-4963-b101-aa9f758ef322 req-d2d27741-2020-4c14-a048-0504b0380d68 service nova] Creating event network-vif-deleted:a29b275b-5e50-40ac-a543-defb30d49ca9 for instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b on hv-cinder-84727 Jun 23 09:27:51.921884 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-ed1c6e67-6afc-4963-b101-aa9f758ef322 req-d2d27741-2020-4c14-a048-0504b0380d68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032098 Jun 23 09:27:51.922688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 233/474] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:52.012900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:52.013508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:52.020239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:52.020901 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:52.021666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:52.022102 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:52.087379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:52.096758 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2aaa9ba6-e354-4876-a9c2-a8cec7203ce3 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1275 microversion: 2.1 time: 0.088164 Jun 23 09:27:52.097371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 242/475] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:52 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:52.243026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:52.252230 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:52.252562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:52.253283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:52.254491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:52.255173 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:52.342320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:52.343342 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:52.357755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:52.358568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:52.360066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:52.360741 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:52.424928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:52.445063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0f60ac9d-7563-4b8f-8145-1230195a7c39 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.207993 Jun 23 09:27:52.445950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 234/476] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:52 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:52.467566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:52.478294 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:52.480731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:52.481496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-13256858-138d-4160-a63d-a40775fa1bc0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 200 len: 1367 microversion: 2.20 time: 0.145751 Jun 23 09:27:52.491558 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 243/477] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:52 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:53.119469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:53.119469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:53.131313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:53.132045 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:53.133459 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:53.135456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:53.294670 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:53.302270 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-628a503a-5bbd-46ea-9420-b59b3cfa5af8 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.191722 Jun 23 09:27:53.302841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 235/478] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:53 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:53.463154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:53.463866 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:53.470899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:53.471377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:53.472125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:53.472563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:53.500667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:53.501268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:53.507632 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:53.508013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:53.508766 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:53.509198 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:53.522826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] HTTP exception thrown: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Request method failure captured: Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b HTTP/1.1 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDExk2CvKSkMvNreQBm9DmdOozNXfN19Wop-Q2SW5B8d1ew6nlBTGKLuMCEe8gimKbO3pG-F6JTOWskeatjIRpHomsdea2zJ9KcUumvAXuL3aZkrCbuBEzJWY4phi9tXNj14zayNtxRjPfG7ZNlSS-BGEUbQ9ShSM0ogmqhbgxNRQAE Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:27:53.524493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29ece34041e04c78868e53d90b658a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29ece34041e04c78868e53d90b658a82", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 30bc3dba44ed4d14a67e56aa640bf9ca Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:27:53.526224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'bd6f6f87-f812-4fe4-98a4-86bab5a8d39b'} Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:27:53.527255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:27:53.529394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:53.530717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Returning 404 to user: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:27:53.530717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ebcffd67-271e-49ee-8128-3cfaa5934eb2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 404 len: 111 microversion: 2.20 time: 0.029113 Jun 23 09:27:53.530717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 236/479] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:53 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:27:53.535280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-dbf3b06f-7df1-43f9-958d-3d7833227ff8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '.version_select at 0x7f8270bcc820>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:53.603067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:53.606321 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-dbf3b06f-7df1-43f9-958d-3d7833227ff8 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049242089" status: 204 len: 0 microversion: 2.20 time: 0.074589 Jun 23 09:27:53.606902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 237/480] 10.222.0.52 () {60 vars in 1261 bytes} [Thu Jun 23 09:27:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049242089 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 09:27:53.613089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-abf582ba-a2aa-456d-ad82-46a7ff26c598 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.152284 Jun 23 09:27:53.613089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 244/481] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:53 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:54.322750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:54.323333 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:54.330439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:54.331000 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:54.332093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:54.332605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:54.541430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:54.549150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c5af2871-d35e-4ec2-9b79-4ce7a83512b4 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.230832 Jun 23 09:27:54.549711 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 238/482] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:54 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:54.628982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:54.630489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:54.640004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:54.640451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:54.641480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:54.641917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:54.819267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-57f5bc03-cd8c-4d25-955e-fe3d8da8407f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'create', calling method: .version_select at 0x7f8270b84280>, body: {"keypair": {"name": "tempest-keypair-1292167913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWq+SHKMbCCPUGrN6l7TKOGBBbBdfVCwoekA+EtJfo4EtBX1E5OAhSI4M0uTa+qHBs6g/iPE9sf9cE23MrnrXnO7wVuzUWKsluVPa5veiC5MMVXbX/V8AHnQNVL0CbUXw=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:54.833372 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-57f5bc03-cd8c-4d25-955e-fe3d8da8407f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for project 29ece34041e04c78868e53d90b658a82. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:27:54.837399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-57f5bc03-cd8c-4d25-955e-fe3d8da8407f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for user 30bc3dba44ed4d14a67e56aa640bf9ca and project 29ece34041e04c78868e53d90b658a82. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:27:54.851728 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:54.862408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c659cd32-023d-42b6-b319-b48b426f4f87 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1735 microversion: 2.1 time: 0.237941 Jun 23 09:27:54.863232 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 245/483] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:54 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:54.961279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-57f5bc03-cd8c-4d25-955e-fe3d8da8407f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.154002 Jun 23 09:27:54.961798 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 239/484] 10.222.0.52 () {62 vars in 1199 bytes} [Thu Jun 23 09:27:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 09:27:55.107855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-290e352d-b80f-48e0-a6df-9d0d7c1ab87b req-845573a7-8398-4f5e-b2fc-bf9e7680b4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2464f2-3f74-48af-95b2-facbd2d09816", "tag": "7e165660-7f44-4727-aed6-950889dca500"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:55.117854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-290e352d-b80f-48e0-a6df-9d0d7c1ab87b req-845573a7-8398-4f5e-b2fc-bf9e7680b4dc service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:55.118298 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-290e352d-b80f-48e0-a6df-9d0d7c1ab87b req-845573a7-8398-4f5e-b2fc-bf9e7680b4dc service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:55.136273 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-290e352d-b80f-48e0-a6df-9d0d7c1ab87b req-845573a7-8398-4f5e-b2fc-bf9e7680b4dc service nova] Creating event network-changed:7e165660-7f44-4727-aed6-950889dca500 for instance 7e2464f2-3f74-48af-95b2-facbd2d09816 on hv-cinder-84727 Jun 23 09:27:55.141465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-290e352d-b80f-48e0-a6df-9d0d7c1ab87b req-845573a7-8398-4f5e-b2fc-bf9e7680b4dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039593 Jun 23 09:27:55.142123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 246/485] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:27:55.577421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:55.578037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:55.584214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:55.584652 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:55.591447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:55.591447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:55.607810 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:55.760388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:55.767931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-72b5d9e4-8339-4baf-9741-ddd0ed853785 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.196809 Jun 23 09:27:55.768500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 240/486] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:55 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:55.881334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:55.881956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:55.888657 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:55.889109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:55.889869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:55.890306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.022770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:56.031426 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-521570e8-57fb-43b3-9652-d4990bc1481f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1715 microversion: 2.1 time: 0.154789 Jun 23 09:27:56.031996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 247/487] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:55 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:56.132205 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:56.132659 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:56.140088 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.140549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.141320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.141758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.268309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] HTTP exception thrown: Cannot 'detach_volume' instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 while it is in vm_state rescued Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Request method failure captured: Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments/e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18 HTTP/1.1 Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDEzg9sac6w2TmnHl3QCOiv3EI8SyhHECSSQh1A_NSxH37E0bYlp251nhzcT1WsvKjQpRhQQEJLyzjcaUluEGWysd1ORnr4SUf6fqsB3wJnVn2BTqCxv_8lGQonkM8VpP0x5Ml-ydKCbKjiWjefMJECQgfmqSwmNd_ndi8ZTgzcyCVg Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:27:56.269805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_368a6f8fbca64e7791d5330f0a99d086", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 29fe5fb181e2452388d24fd0b7aa5e9f Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:27:56.271422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Cannot 'detach_volume' instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 while it is in vm_state rescued Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'server_id': '65478370-c27f-44f4-a45f-0a5f2bc0dbe9', 'id': 'e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18'} Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:27:56.272294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 while it is in vm_state rescued Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 while it is in vm_state rescued Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:27:56.273875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Returning 409 to user: Cannot 'detach_volume' instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 while it is in vm_state rescued {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:27:56.277562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-603867cf-0c5f-4db3-a8d4-e8ecaaff1a83 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments/e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18" status: 409 len: 152 microversion: 2.1 time: 0.143515 Jun 23 09:27:56.277562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 241/488] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:27:56 2022] DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments/e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 09:27:56.284446 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:56.284973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:56.291084 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.291668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.292444 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.292920 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.322139 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:56.546256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-470a88cd-e81f-4bb5-beb4-2c482100c10c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "POST /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/action" status: 202 len: 0 microversion: 2.1 time: 0.265440 Jun 23 09:27:56.547160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 248/489] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:27:56 2022] POST /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:27:56.555812 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:56.556554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:56.564607 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.565140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.565913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.566354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.785924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:56.786651 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:56.794100 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.794543 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.795439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:56.796011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:56.819684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:56.829019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9e42ca23-4c71-4924-accd-3dec38c0ebe5 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1723 microversion: 2.1 time: 0.277132 Jun 23 09:27:56.834126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 242/490] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:56 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:57.008251 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:57.017717 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4c688ca2-8eb7-4463-8a58-c7f56050eb83 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.236612 Jun 23 09:27:57.018298 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 249/491] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:56 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:57.845647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:57.846258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:57.852725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:57.853175 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:57.853969 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:57.854375 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:58.031730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:58.037908 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:58.038671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:58.040193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d5aa92cf-82c1-46a4-bfe6-8f5f2ee52489 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1723 microversion: 2.1 time: 0.198451 Jun 23 09:27:58.040774 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 243/492] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:57 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:58.045953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:58.046397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:58.047180 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:58.047614 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:58.180613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:58.188179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-862521db-1da0-46a8-aa92-e518982ec9a9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.156912 Jun 23 09:27:58.188730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 250/493] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:58 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:27:58.197227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-668461233", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "730dea22-6746-4fe9-87f5-32cb3807b5fd"}], "security_groups": [{"name": "tempest-securitygroup--1473990643"}], "key_name": "tempest-keypair-1292167913", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:27:58.307887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] validate_networks() for [('730dea22-6746-4fe9-87f5-32cb3807b5fd', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:27:58.753669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:27:58.754113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:27:58.754588 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:27:58.755017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:27:58.756578 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:27:58.764972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:58.765415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:58.766209 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:58.766644 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:58.783487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for project 29ece34041e04c78868e53d90b658a82. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:27:58.787432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Getting quotas for user 30bc3dba44ed4d14a67e56aa640bf9ca and project 29ece34041e04c78868e53d90b658a82. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:27:58.799025 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:27:58.801301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:27:58.949783 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-952f147e-3388-4736-9e8c-4bdc5d17dc45 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.756760 Jun 23 09:27:58.950409 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 244/494] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Jun 23 09:27:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 09:27:58.960444 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-dbbeb0d3-acce-4a53-8c51-2876d04cba18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:58.961046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-dbbeb0d3-acce-4a53-8c51-2876d04cba18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:58.963212 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:58.963871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:27:59.018562 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dbbeb0d3-acce-4a53-8c51-2876d04cba18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:59.025531 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dbbeb0d3-acce-4a53-8c51-2876d04cba18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:59.027088 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dbbeb0d3-acce-4a53-8c51-2876d04cba18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:59.028184 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-dbbeb0d3-acce-4a53-8c51-2876d04cba18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1281 microversion: 2.20 time: 0.071671 Jun 23 09:27:59.028736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 251/495] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:27:58 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:27:59.057557 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:59.058166 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:59.065292 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:59.065736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:59.066495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:59.066944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:59.302465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:27:59.302465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:27:59.302465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:59.302465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:59.303503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:59.304241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:27:59.304241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:27:59.304430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d0c02b34-8836-4da8-96ec-8f27d86e0311 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1723 microversion: 2.1 time: 0.169602 Jun 23 09:27:59.304430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 245/496] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:59 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:27:59.345392 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:27:59.352882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c6249dc4-96fc-4804-bbf0-fed6d9242c2e tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.151628 Jun 23 09:27:59.353440 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 252/497] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:27:59 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:00.046751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:00.047401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:00.053945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:00.054397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:00.055200 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:00.055644 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:00.129164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:00.134180 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:00.135736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:00.136853 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ba4edf0e-2da3-4a98-94ea-6c63df42134d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1285 microversion: 2.20 time: 0.094620 Jun 23 09:28:00.137405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 246/498] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:00 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:00.241486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:00.242133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:00.248591 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:00.249039 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:00.249796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:00.254363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:00.373504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:00.374449 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:00.385839 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:00.387177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:00.388203 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:00.388832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:00.461017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:00.474578 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a74a0d51-a55e-4d0d-9ce3-0ffdb87b061c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1723 microversion: 2.1 time: 0.237059 Jun 23 09:28:00.477843 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 253/499] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:00 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:00.556661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:00.563233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f5fe6df7-a124-4b15-abc3-a791ef4d20b9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.196226 Jun 23 09:28:00.563788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 247/500] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:00 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:01.159277 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:01.160034 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:01.166182 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.166632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.167478 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.168428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.233568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:01.242419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:01.243997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:01.245103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a548339c-90fe-446f-b892-ef404406b309 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1277 microversion: 2.20 time: 0.094330 Jun 23 09:28:01.247004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 254/501] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:01 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:01.492187 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:01.492729 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:01.499496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.499971 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.500740 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.501181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.580401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:01.581550 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:01.588116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.588570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.589368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.590295 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.632840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:01.640982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7d710225-29d3-417c-83d6-a66fdf932aa0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1729 microversion: 2.1 time: 0.152697 Jun 23 09:28:01.641550 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 248/502] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:01 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:01.658179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:01.658845 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:01.665131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.665655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.666489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:01.667030 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:01.719402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:01.726897 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-547b5f5d-7a57-4a3c-b00a-2c4d9ac8efcc tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.150741 Jun 23 09:28:01.727539 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 255/503] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:01 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:01.743891 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2175192f-598e-40a1-b038-3770297d75b0 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089337 Jun 23 09:28:01.744429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 249/504] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:28:01 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:28:02.264258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:02.264874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:02.270846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:02.271320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:02.272079 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:02.272511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:02.358356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:02.372124 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:02.374444 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:02.376026 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ae1d747a-d0cf-4a7e-834c-38b58f696699 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1341 microversion: 2.20 time: 0.115776 Jun 23 09:28:02.378432 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 256/505] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:02 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1341 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:02.699945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-850f642e-f476-4dfe-9857-8229c2df9821 req-4491a1b5-fb30-4a1f-8249-52107da16e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2464f2-3f74-48af-95b2-facbd2d09816", "name": "network-vif-plugged", "status": "completed", "tag": "7e165660-7f44-4727-aed6-950889dca500"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:02.711201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-850f642e-f476-4dfe-9857-8229c2df9821 req-4491a1b5-fb30-4a1f-8249-52107da16e09 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:02.711651 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-850f642e-f476-4dfe-9857-8229c2df9821 req-4491a1b5-fb30-4a1f-8249-52107da16e09 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:02.723825 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-850f642e-f476-4dfe-9857-8229c2df9821 req-4491a1b5-fb30-4a1f-8249-52107da16e09 service nova] Creating event network-vif-plugged:7e165660-7f44-4727-aed6-950889dca500 for instance 7e2464f2-3f74-48af-95b2-facbd2d09816 on hv-cinder-84727 Jun 23 09:28:02.728925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-850f642e-f476-4dfe-9857-8229c2df9821 req-4491a1b5-fb30-4a1f-8249-52107da16e09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037495 Jun 23 09:28:02.729712 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 250/506] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:02.744582 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:02.745202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:02.752744 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:02.753205 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:02.753977 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:02.754471 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:02.945990 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-2d057353-3e54-4dd5-9d4d-f02e4b661ab6 req-cc818f31-5d63-4d59-9c96-8284ee0f16d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65478370-c27f-44f4-a45f-0a5f2bc0dbe9", "tag": "d80dcfb6-742d-4015-9492-0b79f1b71413"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:02.975390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-2d057353-3e54-4dd5-9d4d-f02e4b661ab6 req-cc818f31-5d63-4d59-9c96-8284ee0f16d9 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:02.976317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-2d057353-3e54-4dd5-9d4d-f02e4b661ab6 req-cc818f31-5d63-4d59-9c96-8284ee0f16d9 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:02.993314 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-2d057353-3e54-4dd5-9d4d-f02e4b661ab6 req-cc818f31-5d63-4d59-9c96-8284ee0f16d9 service nova] Creating event network-changed:d80dcfb6-742d-4015-9492-0b79f1b71413 for instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 on hv-cinder-84727 Jun 23 09:28:02.997602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:02.999825 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-2d057353-3e54-4dd5-9d4d-f02e4b661ab6 req-cc818f31-5d63-4d59-9c96-8284ee0f16d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058969 Jun 23 09:28:03.000767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 251/507] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:03.006526 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-284fc790-7f6a-4872-901a-c37bc6e1e181 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.265425 Jun 23 09:28:03.016538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 257/508] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:02 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:03.396342 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:03.399502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:03.405494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:03.405937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:03.406721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:03.407187 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:03.541001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:03.549257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:03.550837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:03.551968 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0e2a67b1-d0fe-4189-bc58-eae288426e68 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.160428 Jun 23 09:28:03.552551 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 252/509] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:03 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:04.023937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:04.024544 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:04.031668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:04.032114 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:04.032866 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:04.033297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:04.263376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:04.276270 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5f51eeee-b7cd-4d5c-b57f-8483ab6b3b7f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1315 microversion: 2.1 time: 0.255808 Jun 23 09:28:04.277306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 258/510] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:04 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:04.570000 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:04.570619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:04.578276 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:04.578726 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:04.579527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:04.579964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:04.717482 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:04.725767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:04.727311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:04.731186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6023f040-4c6a-4804-b969-6487f433f6fb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.162435 Jun 23 09:28:04.731186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 253/511] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:04 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:04.755963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-c4fcc81e-6b33-4399-b28b-86b3f8ebfbff req-ed479b43-8e64-41f3-98dd-4d990552116b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:04.766600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-c4fcc81e-6b33-4399-b28b-86b3f8ebfbff req-ed479b43-8e64-41f3-98dd-4d990552116b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:04.767566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-c4fcc81e-6b33-4399-b28b-86b3f8ebfbff req-ed479b43-8e64-41f3-98dd-4d990552116b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:04.781916 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-c4fcc81e-6b33-4399-b28b-86b3f8ebfbff req-ed479b43-8e64-41f3-98dd-4d990552116b service nova] Creating event network-changed:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:28:04.787195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-c4fcc81e-6b33-4399-b28b-86b3f8ebfbff req-ed479b43-8e64-41f3-98dd-4d990552116b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 Jun 23 09:28:04.787791 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 259/512] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:28:05.016653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-326ab391-05ea-4606-9fd7-b175c73923c6 req-8c6f0487-f48f-44c0-8a38-a6b962b3a732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65478370-c27f-44f4-a45f-0a5f2bc0dbe9", "tag": "d80dcfb6-742d-4015-9492-0b79f1b71413"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:05.024717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-326ab391-05ea-4606-9fd7-b175c73923c6 req-8c6f0487-f48f-44c0-8a38-a6b962b3a732 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.025170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-326ab391-05ea-4606-9fd7-b175c73923c6 req-8c6f0487-f48f-44c0-8a38-a6b962b3a732 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.036392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-326ab391-05ea-4606-9fd7-b175c73923c6 req-8c6f0487-f48f-44c0-8a38-a6b962b3a732 service nova] Creating event network-changed:d80dcfb6-742d-4015-9492-0b79f1b71413 for instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 on hv-cinder-84727 Jun 23 09:28:05.041193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-326ab391-05ea-4606-9fd7-b175c73923c6 req-8c6f0487-f48f-44c0-8a38-a6b962b3a732 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028340 Jun 23 09:28:05.041750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 254/513] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:05.295052 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:05.296571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:05.303796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.304306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.305099 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.305535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.502085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:05.509665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-779e874a-9926-42f3-a970-4111d564a47c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1465 microversion: 2.1 time: 0.219640 Jun 23 09:28:05.510233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 260/514] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:05 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1465 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:05.550709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:05.551354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:05.558838 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.559377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.560282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.560735 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.590943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:28:05.747079 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:05.747825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:05.753825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.754278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.755162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.755603 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.811608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:05.942494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2d56a75b-78aa-4d15-9593-a57cd2ed695c tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 204 len: 0 microversion: 2.1 time: 0.395713 Jun 23 09:28:05.943313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 255/515] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:28:05 2022] DELETE /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:28:05.951620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:05.952312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:05.959037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.959236 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:05.968826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.968826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:05.968826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:05.977398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:05.979114 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:05.980893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-77138f60-b2b5-417f-abeb-693f97d020f5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.237783 Jun 23 09:28:05.981714 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 261/516] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:05 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:28:06.096581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:06.104068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-722e49a5-0193-4f37-9b49-4a3fd7215cd5 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1471 microversion: 2.1 time: 0.156445 Jun 23 09:28:06.104629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 256/517] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:05 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:06.999449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:07.000057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:07.006636 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:07.007112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:07.007862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:07.008291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:07.121695 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:07.122303 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:07.128948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:07.129399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:07.130152 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:07.130587 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:07.135816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:07.144770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:07.146331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:07.147470 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2e1b820e-5f0a-4f01-a6ea-3862b2db1416 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.152029 Jun 23 09:28:07.148038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 262/518] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:06 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:07.259629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:07.267735 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c6f453d0-b4c7-4f2d-88b1-ba8a150beb4b tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1471 microversion: 2.1 time: 0.150045 Jun 23 09:28:07.268326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 257/519] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:07 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:08.165609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:08.166214 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:08.172749 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:08.173193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:08.173946 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:08.174375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:08.285750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:08.286389 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:08.292926 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:08.295649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:08.295649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:08.295649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:08.304771 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:08.312915 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:08.313231 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:08.314737 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:08.315918 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3e129974-532d-4cb2-8b48-11a36118c84f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.154221 Jun 23 09:28:08.316497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 263/520] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:08 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:08.421116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:08.428281 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8fbf422d-55ff-4d0a-89cc-f6d10544e416 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1471 microversion: 2.1 time: 0.146779 Jun 23 09:28:08.428844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 258/521] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:08 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:09.128928 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-eaff7daf-63c6-48cf-a6e2-d44d4b29259c req-f8591104-24d6-45c9-8cbe-b0156e72a31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2464f2-3f74-48af-95b2-facbd2d09816", "name": "network-vif-deleted", "tag": "7e165660-7f44-4727-aed6-950889dca500"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:09.137261 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-eaff7daf-63c6-48cf-a6e2-d44d4b29259c req-f8591104-24d6-45c9-8cbe-b0156e72a31b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:09.137708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-eaff7daf-63c6-48cf-a6e2-d44d4b29259c req-f8591104-24d6-45c9-8cbe-b0156e72a31b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:09.150104 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-eaff7daf-63c6-48cf-a6e2-d44d4b29259c req-f8591104-24d6-45c9-8cbe-b0156e72a31b service nova] Creating event network-vif-deleted:7e165660-7f44-4727-aed6-950889dca500 for instance 7e2464f2-3f74-48af-95b2-facbd2d09816 on hv-cinder-84727 Jun 23 09:28:09.156132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-eaff7daf-63c6-48cf-a6e2-d44d4b29259c req-f8591104-24d6-45c9-8cbe-b0156e72a31b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031280 Jun 23 09:28:09.157007 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 264/522] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:09.334041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:09.334608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:09.336415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:09.337082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=14 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:09.342566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:09.348378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:09.348378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:09.348378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:09.446730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:09.447471 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:09.450133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:09.455194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:09.455648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:09.456490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:09.456929 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:09.476671 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:09.485378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:09.486879 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:09.488006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5d1b6ee6-3404-48e7-bfd5-eb36b6b2fd7d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.158385 Jun 23 09:28:09.488567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 259/523] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:09 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:09.521018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72001a6a6daf4840a2c0133e25597698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a012cfeede49989fda04fdd2ba45ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:09.528727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e9008318-db35-408d-9202-7f7cea3c888f tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 200 len: 1300 microversion: 2.1 time: 0.086599 Jun 23 09:28:09.529293 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 265/524] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:09 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:10.505721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:10.506279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:10.514241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:10.514943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:10.515900 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:10.516341 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:10.545900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:10.547288 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] [instance: 7e2464f2-3f74-48af-95b2-facbd2d09816] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:10.550117 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:10.558666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:10.559296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:10.560074 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:10.560508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:10.577623 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] HTTP exception thrown: Instance 7e2464f2-3f74-48af-95b2-facbd2d09816 could not be found. Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Request method failure captured: Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 HTTP/1.1 Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDIRXZkErl9SuUXuxyk0XAktWpYCSgpc2k43eDJE1PwrbHIuxRNcP0ogJ09XaNThL6rR-9amPhOz_lDIKYGzcotHdu61wzv1GonY32Qm5JYRRs4dS0lWBN3ixL5i9lkWn5dmJe9-ALLXpliu7QKSyG7Z9q43ryr7GcQpGSs3HRFP69U Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: e0a012cfeede49989fda04fdd2ba45ad Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesNegativeTest-1382338384 Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:28:10.579306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e0a012cfeede49989fda04fdd2ba45ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e0a012cfeede49989fda04fdd2ba45ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e0a012cfeede49989fda04fdd2ba45ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e0a012cfeede49989fda04fdd2ba45ad", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesNegativeTest-1382338384 Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: e0a012cfeede49989fda04fdd2ba45ad Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesNegativeTest-1382338384 Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesNegativeTest-1382338384-project Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 72001a6a6daf4840a2c0133e25597698 Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesNegativeTest-1382338384-project Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 7e2464f2-3f74-48af-95b2-facbd2d09816 could not be found. Jun 23 09:28:10.580887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '7e2464f2-3f74-48af-95b2-facbd2d09816'} Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2464f2-3f74-48af-95b2-facbd2d09816 could not be found. Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:28:10.581826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2464f2-3f74-48af-95b2-facbd2d09816 could not be found. Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2464f2-3f74-48af-95b2-facbd2d09816 could not be found. Jun 23 09:28:10.583199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:10.584411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] Returning 404 to user: Instance 7e2464f2-3f74-48af-95b2-facbd2d09816 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:28:10.584411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c700f9db-2a1f-410b-b182-6e58ca8a4be9 tempest-VolumesNegativeTest-1382338384 tempest-VolumesNegativeTest-1382338384-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816" status: 404 len: 111 microversion: 2.1 time: 0.038682 Jun 23 09:28:10.584411 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 266/525] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:10 2022] GET /compute/v2.1/servers/7e2464f2-3f74-48af-95b2-facbd2d09816 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:28:10.658718 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:10.667138 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:10.668717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:10.669893 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3a3dd00d-05ce-4f1a-b374-6490473da333 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.168185 Jun 23 09:28:10.671833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 260/526] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:10 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:11.700389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:11.701024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:11.708033 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:11.708484 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:11.709238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:11.709673 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:11.727145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:11.839959 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:11.847931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:11.849417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:11.850501 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3085851e-ba9f-4869-ba82-334afdd06cf9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.153954 Jun 23 09:28:11.851065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 267/527] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:11 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:12.773062 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-44c24c1d-d338-465a-89c2-3b5a69cba4ce req-7159fbd4-6c94-42c7-a864-aca4b5fd2de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "name": "network-vif-plugged", "status": "completed", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:12.783395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-44c24c1d-d338-465a-89c2-3b5a69cba4ce req-7159fbd4-6c94-42c7-a864-aca4b5fd2de8 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:12.783909 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-44c24c1d-d338-465a-89c2-3b5a69cba4ce req-7159fbd4-6c94-42c7-a864-aca4b5fd2de8 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:12.795639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-44c24c1d-d338-465a-89c2-3b5a69cba4ce req-7159fbd4-6c94-42c7-a864-aca4b5fd2de8 service nova] Creating event network-vif-plugged:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:28:12.801113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-44c24c1d-d338-465a-89c2-3b5a69cba4ce req-7159fbd4-6c94-42c7-a864-aca4b5fd2de8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Jun 23 09:28:12.801693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 261/528] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:12.868834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:12.869417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:12.877050 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:12.877526 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:12.878243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:12.878675 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:13.013237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:13.021175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:13.022683 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:13.023811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d08244b2-1b4b-4776-9ed2-db7290eb982c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.158845 Jun 23 09:28:13.024372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 268/529] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:12 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:14.044157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:14.044765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:14.051602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:14.052047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:14.052808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:14.053239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:14.189429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:14.197337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:14.201472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:14.201472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-75bb7d67-9ecd-4b61-8046-aef3613dda51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1407 microversion: 2.20 time: 0.160861 Jun 23 09:28:14.201472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 262/530] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:14 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:28:15.218066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:15.218676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:15.225198 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.225648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.226402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.226834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.363272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:15.373803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:15.375460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:15.376652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-114c1a11-f173-4322-a924-14a5d1850984 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1599 microversion: 2.20 time: 0.162521 Jun 23 09:28:15.378447 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 269/531] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:15 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:15.395862 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:15.396390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:15.403071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.403447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.404229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.404649 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.482380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-891848e5-a1bb-4113-ac7d-0b628383da51 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090343 Jun 23 09:28:15.483019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 263/532] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Jun 23 09:28:15 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:28:15.625409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:15.625894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:15.631870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.632315 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.633069 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.633497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.656400 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a191df60-fde0-48bb-b9f7-5e4b0af7bf89 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/ips" status: 200 len: 150 microversion: 2.1 time: 0.035351 Jun 23 09:28:15.656915 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 270/533] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:28:15 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:15.677348 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "307ce01e-40c0-4660-94f6-53bea8447325"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:15.678745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:15.685935 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.686562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.687364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.687800 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.796942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Invalid volume: volume 307ce01e-40c0-4660-94f6-53bea8447325 is already attached to instances: f0a229b3-a377-4881-9f1c-769d10ba375b Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: POST /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/os-volume_attachments HTTP/1.1 Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 74 Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:28:15.798645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {"volumeAttachment": {"volumeId": "307ce01e-40c0-4660-94f6-53bea8447325"}} Jun 23 09:28:15.800475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Invalid volume: volume 307ce01e-40c0-4660-94f6-53bea8447325 is already attached to instances: f0a229b3-a377-4881-9f1c-769d10ba375b Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'server_id': 'da4d3349-a28c-4fb0-8cb5-12cad9123599', 'body': {'volumeAttachment': {'volumeId': '307ce01e-40c0-4660-94f6-53bea8447325'}}} Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 307ce01e-40c0-4660-94f6-53bea8447325 is already attached to instances: f0a229b3-a377-4881-9f1c-769d10ba375b Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:15.801517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 307ce01e-40c0-4660-94f6-53bea8447325 is already attached to instances: f0a229b3-a377-4881-9f1c-769d10ba375b Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:15.803128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 307ce01e-40c0-4660-94f6-53bea8447325 is already attached to instances: f0a229b3-a377-4881-9f1c-769d10ba375b Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 400 to user: Invalid volume: volume 307ce01e-40c0-4660-94f6-53bea8447325 is already attached to instances: f0a229b3-a377-4881-9f1c-769d10ba375b {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d2e56ebc-a001-4b23-a73f-d19b3f9acca6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136560 Jun 23 09:28:15.805229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 264/534] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:28:15 2022] POST /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:28:15.809334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:15.809833 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:15.815933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.816482 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.817408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:15.817859 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:15.843826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:28:16.150045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1d7a832e-dc86-42a4-8e67-1306e332f4d5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 204 len: 0 microversion: 2.1 time: 0.344570 Jun 23 09:28:16.154438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 271/535] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:28:15 2022] DELETE /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:28:16.159438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:16.160055 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:16.166044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:16.166488 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:16.167296 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:16.167761 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:16.382554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:16.390896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-df92725b-c19c-4445-8d60-2816c024741e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1682 microversion: 2.1 time: 0.235193 Jun 23 09:28:16.391494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 265/536] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:16 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:16.600932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-4b80e3c3-8dfb-41ca-b34b-9d4ec2140ee7 req-0cbf639a-9688-40f5-bdb2-eb6f0e9ba9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:16.610461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4b80e3c3-8dfb-41ca-b34b-9d4ec2140ee7 req-0cbf639a-9688-40f5-bdb2-eb6f0e9ba9cb service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:16.634030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4b80e3c3-8dfb-41ca-b34b-9d4ec2140ee7 req-0cbf639a-9688-40f5-bdb2-eb6f0e9ba9cb service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:16.634030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-4b80e3c3-8dfb-41ca-b34b-9d4ec2140ee7 req-0cbf639a-9688-40f5-bdb2-eb6f0e9ba9cb service nova] Creating event network-changed:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:28:16.634030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-4b80e3c3-8dfb-41ca-b34b-9d4ec2140ee7 req-0cbf639a-9688-40f5-bdb2-eb6f0e9ba9cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029711 Jun 23 09:28:16.634030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 272/537] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:17.409419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:17.410675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:17.416916 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:17.417382 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:17.418765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:17.419227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:17.566361 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:17.574967 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b2cb9e52-3fed-4def-9d75-fb2c9e763964 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1682 microversion: 2.1 time: 0.169276 Jun 23 09:28:17.575555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 266/538] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:17 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:18.593708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:18.594415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:18.600691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:18.601155 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:18.601915 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:18.602452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:18.667827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:18.675335 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-40e792bc-42f4-47f7-90f8-630f43cb52fc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1615 microversion: 2.1 time: 0.086936 Jun 23 09:28:18.675899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 273/539] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:18 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:18.869070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-48f01e5a-1615-4018-9dd1-b826eb5bd11d req-9b6fbeb1-dd39-493f-affa-b4bd557197c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4d3349-a28c-4fb0-8cb5-12cad9123599", "name": "network-vif-deleted", "tag": "e1a628b3-9901-4e94-8ad7-07ac85c70f71"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:18.883074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-48f01e5a-1615-4018-9dd1-b826eb5bd11d req-9b6fbeb1-dd39-493f-affa-b4bd557197c3 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:18.883881 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-48f01e5a-1615-4018-9dd1-b826eb5bd11d req-9b6fbeb1-dd39-493f-affa-b4bd557197c3 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:18.906058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-48f01e5a-1615-4018-9dd1-b826eb5bd11d req-9b6fbeb1-dd39-493f-affa-b4bd557197c3 service nova] Creating event network-vif-deleted:e1a628b3-9901-4e94-8ad7-07ac85c70f71 for instance da4d3349-a28c-4fb0-8cb5-12cad9123599 on hv-cinder-84727 Jun 23 09:28:18.912709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-48f01e5a-1615-4018-9dd1-b826eb5bd11d req-9b6fbeb1-dd39-493f-affa-b4bd557197c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047563 Jun 23 09:28:18.913437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 267/540] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:19.693309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:19.693924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:19.702321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:19.702814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:19.703667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:19.704106 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:19.738312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:19.738763 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:19.739498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'fault' on Instance uuid da4d3349-a28c-4fb0-8cb5-12cad9123599 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:28:19.786580 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:19.796261 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a608fac2-0d32-4909-b8a4-499cd9efa3d9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 200 len: 1332 microversion: 2.1 time: 0.107067 Jun 23 09:28:19.797173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 274/541] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:19 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:20.814945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:20.816211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:20.823804 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:20.824532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:20.825483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:20.826087 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:20.852390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 HTTP/1.1 Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:28:20.864345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:28:20.866177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'da4d3349-a28c-4fb0-8cb5-12cad9123599'} Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:28:20.867223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:28:20.868736 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:28:20.869966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:28:20.869966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b2046fa7-4ffa-40b5-a795-6deac4a6a982 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 404 len: 111 microversion: 2.1 time: 0.045289 Jun 23 09:28:20.869966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 268/542] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:20 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:28:20.870215 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-704eb225-c795-4d01-b724-c90929e4ca5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '.version_select at 0x7f82709ff9d0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:20.940614 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-704eb225-c795-4d01-b724-c90929e4ca5d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376545613" status: 202 len: 0 microversion: 2.1 time: 0.078848 Jun 23 09:28:20.941342 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 275/543] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376545613 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:28:21.831784 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:21.832282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:21.840150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:21.840539 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:21.841322 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:21.841757 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:21.942108 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'services' on Instance uuid f0a229b3-a377-4881-9f1c-769d10ba375b {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:28:22.246442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-36ff9641-37ff-497c-ae60-1a211ed44b18 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments/307ce01e-40c0-4660-94f6-53bea8447325" status: 202 len: 0 microversion: 2.1 time: 0.418471 Jun 23 09:28:22.251516 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 269/544] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:28:21 2022] DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments/307ce01e-40c0-4660-94f6-53bea8447325 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:28:22.255595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:22.263481 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:22.271065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:22.271520 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:22.272297 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:22.272735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:22.311054 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1abe75e9-abee-443b-ac7f-c66595a44b82 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059657 Jun 23 09:28:22.311715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 276/545] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:28:22 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:28:23.324093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:23.325146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:23.331387 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:23.331835 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:23.332592 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:23.333027 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:23.367076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-be335c77-1450-460c-9861-872273ad9d22 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047859 Jun 23 09:28:23.367824 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 270/546] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:28:23 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:24.379244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:24.380773 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:24.394564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:24.395250 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:24.396644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:24.397386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:24.430596 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f7bf938f-497a-40e1-b19d-c424ad1a60be tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055548 Jun 23 09:28:24.432004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 277/547] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:28:24 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:28:24.505113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:24.505954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:24.512211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:24.512669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:24.513450 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:24.514085 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:24.541334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:28:24.887611 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1512a878-b064-48a9-b9d8-0a1f588486ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 204 len: 0 microversion: 2.1 time: 0.388621 Jun 23 09:28:24.888272 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 271/548] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:28:24 2022] DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:28:24.896461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:24.897218 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:24.904017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:24.906831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:24.906831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:24.906831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:25.055016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:25.070372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fb253e7f-4fdf-422d-bfb1-b1f6d5ae0cec tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1682 microversion: 2.1 time: 0.177717 Jun 23 09:28:25.070979 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 278/549] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:24 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:26.090147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:26.090760 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:26.097576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:26.098022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:26.098793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:26.099239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:26.299684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:26.308852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-95cae829-aacd-4cd2-bee9-3f4986fb51b3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1682 microversion: 2.1 time: 0.222968 Jun 23 09:28:26.309425 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 272/550] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:26 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:27.325707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:27.327015 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:27.334418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:27.335201 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:27.335981 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:27.336416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:27.505572 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:27.514052 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2676d495-d45a-44f2-83ea-b31560ef81fe tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1682 microversion: 2.1 time: 0.192248 Jun 23 09:28:27.523919 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 279/551] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:27 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:28.532594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:28.534331 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:28.541419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:28.551239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:28.551239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:28.551239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:28.669877 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:28.690061 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a428a203-311a-4c22-a317-768bd7f17612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1614 microversion: 2.1 time: 0.161931 Jun 23 09:28:28.701862 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 273/552] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:28 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1614 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:28.845421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-c71b69be-22c4-453a-88ff-74c3d676ea2c req-3eded7d1-2807-4025-8659-e276f6fc1102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a229b3-a377-4881-9f1c-769d10ba375b", "name": "network-vif-deleted", "tag": "d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:28.867818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-c71b69be-22c4-453a-88ff-74c3d676ea2c req-3eded7d1-2807-4025-8659-e276f6fc1102 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:28.868312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-c71b69be-22c4-453a-88ff-74c3d676ea2c req-3eded7d1-2807-4025-8659-e276f6fc1102 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:28.889266 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-c71b69be-22c4-453a-88ff-74c3d676ea2c req-3eded7d1-2807-4025-8659-e276f6fc1102 service nova] Creating event network-vif-deleted:d3fa4fcd-e2dc-48ea-b2d5-1dbb442965c3 for instance f0a229b3-a377-4881-9f1c-769d10ba375b on hv-cinder-84727 Jun 23 09:28:28.895737 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-c71b69be-22c4-453a-88ff-74c3d676ea2c req-3eded7d1-2807-4025-8659-e276f6fc1102 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059627 Jun 23 09:28:28.897560 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 280/553] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:29.709044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:29.712716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:29.718711 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:29.719446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:29.720470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:29.721070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:29.780647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:29.781654 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:29.781654 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'fault' on Instance uuid f0a229b3-a377-4881-9f1c-769d10ba375b {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:28:29.833749 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:29.837587 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:29.847380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-722d5472-bb8f-4b2b-b74c-8482be3ec8fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 200 len: 1331 microversion: 2.1 time: 0.143302 Jun 23 09:28:29.848915 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 274/554] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:29 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:30.866398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:30.867594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:30.874757 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:30.875240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:30.876007 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:30.876445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:30.891953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b HTTP/1.1 Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:28:30.893630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:28:30.895092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'f0a229b3-a377-4881-9f1c-769d10ba375b'} Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:28:30.895971 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:28:30.897209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:30.898430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:28:30.898430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-216409c6-07cb-4d34-ac40-8f0359857eb6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 404 len: 111 microversion: 2.1 time: 0.032824 Jun 23 09:28:30.898430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 281/555] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:30 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:28:30.904637 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8d48d2a3-80b1-4950-a6e7-dddf181b00a4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '.version_select at 0x7f8270b810d0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:31.006786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8d48d2a3-80b1-4950-a6e7-dddf181b00a4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079230074" status: 202 len: 0 microversion: 2.1 time: 0.106441 Jun 23 09:28:31.007493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 275/556] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079230074 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:28:32.006813 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d53343cf-7f26-402b-9d29-2a7f8ff53ac3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: .version_select at 0x7f8270aa41f0>, body: {"keypair": {"name": "tempest-keypair-1230979419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEzNqc2nFEcH2GtBqIUXx0vwEIPaN0DpBzQA0WCkwKDDhCFl7YjS4la9YzmxeeQ2QIcRx5hk944XMXcMMSbD5YOlsUb9KfnjH8IZUXBU6u4lUJnlbLS3MpRNgHuw1yw0A=="}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:32.034105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-d53343cf-7f26-402b-9d29-2a7f8ff53ac3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:28:32.038341 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-d53343cf-7f26-402b-9d29-2a7f8ff53ac3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:28:32.149186 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d53343cf-7f26-402b-9d29-2a7f8ff53ac3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146277 Jun 23 09:28:32.149782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 282/557] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:28:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:34.893864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1226586246", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "308c25e5-5cce-431f-b4d9-9d80a125cd28"}], "security_groups": [{"name": "tempest-securitygroup--1465778672"}], "key_name": "tempest-keypair-1230979419", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:35.035857 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] validate_networks() for [('308c25e5-5cce-431f-b4d9-9d80a125cd28', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:28:35.494937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:28:35.494937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:28:35.494937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:28:35.495837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:28:35.496178 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:28:35.507549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:35.508244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:35.509237 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:35.509668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:35.530245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:28:35.535039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:28:35.548430 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:28:35.551206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:28:35.983918 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fb8cd25d-91e5-4ab1-a0bd-7ff08e552bd7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.095876 Jun 23 09:28:35.985511 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 276/558] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:28:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:28:36.000597 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cd8c916a-e225-45d3-97f5-c85c35e3449b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:36.000597 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cd8c916a-e225-45d3-97f5-c85c35e3449b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:36.277660 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cd8c916a-e225-45d3-97f5-c85c35e3449b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:36.290263 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cd8c916a-e225-45d3-97f5-c85c35e3449b tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1242 microversion: 2.1 time: 0.298936 Jun 23 09:28:36.291021 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 283/559] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:35 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:37.308377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:37.309609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:37.312143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:37.324362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:37.326650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:37.341844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:37.345355 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:37.420928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:37.429987 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4f64063d-57dd-44ef-8cfd-2882d1783c93 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1246 microversion: 2.1 time: 0.126110 Jun 23 09:28:37.431106 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 277/560] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:37 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:38.447895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:38.449665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:38.456125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:38.456582 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:38.457349 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:38.457783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:38.558465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:38.570674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-607f5abc-73aa-421d-8e03-80ebbbe9622d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1294 microversion: 2.1 time: 0.126523 Jun 23 09:28:38.572003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 284/561] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:38 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:39.588771 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:39.589385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:39.596613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:39.597063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:39.597828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:39.598269 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:39.659224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:39.666668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-367ab9f6-4dac-49c5-a241-92ea422691d0 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1300 microversion: 2.1 time: 0.081882 Jun 23 09:28:39.667863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 278/562] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:39 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:40.744546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:40.744546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:40.748032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:40.748789 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:40.749596 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:40.750030 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:40.909499 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:40.921997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f6a07ea6-b1fa-4a27-9d83-4bc2381e1933 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.188078 Jun 23 09:28:40.925497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 285/563] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:40 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:40.983682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-b033e35b-c883-4cc3-a3c8-bdc562037fe1 req-af48ccc0-c8fe-4364-b538-a11566defce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e58a13-6ee6-4d01-840f-50a6cc456fb9", "tag": "63dcea29-ad70-42db-bd2d-65baa87be113"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:41.003154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-b033e35b-c883-4cc3-a3c8-bdc562037fe1 req-af48ccc0-c8fe-4364-b538-a11566defce2 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:41.003154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-b033e35b-c883-4cc3-a3c8-bdc562037fe1 req-af48ccc0-c8fe-4364-b538-a11566defce2 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:41.017796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-b033e35b-c883-4cc3-a3c8-bdc562037fe1 req-af48ccc0-c8fe-4364-b538-a11566defce2 service nova] Creating event network-changed:63dcea29-ad70-42db-bd2d-65baa87be113 for instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 on hv-cinder-84727 Jun 23 09:28:41.026544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-b033e35b-c883-4cc3-a3c8-bdc562037fe1 req-af48ccc0-c8fe-4364-b538-a11566defce2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046769 Jun 23 09:28:41.027682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 279/564] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:41.942454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:41.943243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:41.945528 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:41.946080 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:41.946208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:41.952136 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:41.952758 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:41.953607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:41.954149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:41.963127 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:41.963572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:41.968991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:41.969617 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:42.087526 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'services' on Instance uuid 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:28:42.135611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:42.143428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-dc70020f-af28-4955-93f8-4e2fed0115d4 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.205585 Jun 23 09:28:42.144541 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 286/565] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:41 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:42.355633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4814210b-95ec-4b72-84d7-de0941d9ab36 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments/e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18" status: 202 len: 0 microversion: 2.1 time: 0.414857 Jun 23 09:28:42.356603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 280/566] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:28:41 2022] DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments/e9e52ab8-c805-4dfa-b1ca-e7080ecb8f18 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:28:42.367649 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:42.368739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:42.375507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:42.376219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:42.377290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:42.377998 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:42.397176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:42.412943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fd28cf9a-b809-4b46-ab7c-ed352415994e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051386 Jun 23 09:28:42.413737 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 287/567] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:28:42 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:43.161765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:43.162462 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:43.169086 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:43.169530 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:43.170307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:43.170716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:43.302457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:43.310496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-edb49731-7399-4094-bb03-676a53f4b8bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.153074 Jun 23 09:28:43.311083 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 281/568] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:43 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:43.435334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:43.436375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:43.447702 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:43.448625 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:43.449985 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:43.451525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:43.497284 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b00ea15d-1f18-4c21-ab2b-520e3451760d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072021 Jun 23 09:28:43.498095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 288/569] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:28:43 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:44.138018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5cb78eb8-6fde-4721-9d99-177fb6feb4b7 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Action: 'create', calling method: .version_select at 0x7f8270afa8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-702940458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsCV0TaIBH/LLM5trKEI7QObYW8iIIvMyNbrlzlwm4txlSu6dlBCevfgxJ9SRX3/ytsivEa34OARq1S4ce71RSqRMuH4N2g3JkRuL5baQekAUFO7sN0LzdfeHKkHeBoAg=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:44.151619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-5cb78eb8-6fde-4721-9d99-177fb6feb4b7 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Getting quotas for project f17a6a1110a2462b98908ecbc67564f9. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:28:44.156696 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-5cb78eb8-6fde-4721-9d99-177fb6feb4b7 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Getting quotas for user fc1a2967d343413d8eb72de6a49ba653 and project f17a6a1110a2462b98908ecbc67564f9. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:28:44.253652 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5cb78eb8-6fde-4721-9d99-177fb6feb4b7 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.119462 Jun 23 09:28:44.254464 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 282/570] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:28:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:44.319739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2121681504", "imageRef": "b0e7da9a-bcae-43ec-b7b4-394a2f29d8fb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-702940458", "networks": [{"uuid": "3e6d8e95-96b3-49d4-8814-891949660fde"}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:44.327581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:44.328195 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:44.334500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.335244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.335728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.336158 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.373574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] validate_networks() for [('3e6d8e95-96b3-49d4-8814-891949660fde', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:28:44.466363 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:44.473753 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-99803503-44cd-49d0-be0c-a2fb8e213761 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.150633 Jun 23 09:28:44.474310 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 283/571] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:44 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:44.509647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:44.510552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:44.516637 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.517132 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.517839 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.518267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.547672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e370218a-1d3e-4c88-9f95-a0168334bb2c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042041 Jun 23 09:28:44.548238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 284/572] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:28:44 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 09:28:44.616836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:44.617334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:44.623645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.624105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.624874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.625317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.650376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:28:44.752282 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:28:44.753063 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:28:44.753183 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:28:44.753587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:28:44.753980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:28:44.762935 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.763466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.764271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:44.764709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:44.781368 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Getting quotas for project f17a6a1110a2462b98908ecbc67564f9. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:28:44.785292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Getting quotas for user fc1a2967d343413d8eb72de6a49ba653 and project f17a6a1110a2462b98908ecbc67564f9. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:28:44.796824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:28:44.799048 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0e7da9a-bcae-43ec-b7b4-394a2f29d8fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:28:45.003703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-857dabf9-52ba-4beb-81e2-a619614b957e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687785 Jun 23 09:28:45.004666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 289/573] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:28:45.014003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6df10c2d-d787-4b81-9273-699efbb39278 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:45.014614 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6df10c2d-d787-4b81-9273-699efbb39278 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:45.084568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6df10c2d-d787-4b81-9273-699efbb39278 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:45.092572 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6df10c2d-d787-4b81-9273-699efbb39278 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1258 microversion: 2.1 time: 0.082346 Jun 23 09:28:45.093129 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 290/574] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:45 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:45.105155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-45fdc1e3-d825-492d-8ea5-7f833111a577 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 204 len: 0 microversion: 2.1 time: 0.491523 Jun 23 09:28:45.105980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 285/575] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:28:44 2022] DELETE /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:28:45.114676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:45.115162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:45.121233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:45.121686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:45.122457 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:45.122895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:45.258760 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:45.266353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ea9b509d-034d-4e37-9a9e-41687b152a5d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1689 microversion: 2.1 time: 0.156028 Jun 23 09:28:45.267227 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 291/576] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:45 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:45.492122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:45.492814 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:45.499214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:45.499659 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:45.500407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:45.500837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:45.518639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:45.630648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:45.638553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0c474ad8-a969-4ef1-a5bc-3bc7172e89d3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.150877 Jun 23 09:28:45.639144 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 286/577] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:45 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:46.109048 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-81fa7579-033a-4f7f-a789-4846f503ada5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:46.109684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-81fa7579-033a-4f7f-a789-4846f503ada5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:46.161742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-81fa7579-033a-4f7f-a789-4846f503ada5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:46.168482 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-81fa7579-033a-4f7f-a789-4846f503ada5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1258 microversion: 2.1 time: 0.063313 Jun 23 09:28:46.169045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 292/578] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:46 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:46.283370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:46.283977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:46.289947 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:46.290389 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:46.291165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:46.291741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:46.419737 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:46.427168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-49fb52e8-5611-4a8b-8869-af76ddcb08b8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1689 microversion: 2.1 time: 0.147605 Jun 23 09:28:46.427727 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 287/579] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:46 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:46.656061 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:46.661401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:46.664778 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:46.665230 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:46.665992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:46.666431 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:46.791380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:46.799176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3ce271d0-aeef-4533-a82a-088beac13cc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.147737 Jun 23 09:28:46.799775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 293/580] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:46 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:46.928135 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-33584b98-303f-41d1-84ef-d543a110fc01 req-13e0476c-9433-4b16-a028-f3e8ec41a628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e58a13-6ee6-4d01-840f-50a6cc456fb9", "name": "network-vif-plugged", "status": "completed", "tag": "63dcea29-ad70-42db-bd2d-65baa87be113"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:46.937255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-33584b98-303f-41d1-84ef-d543a110fc01 req-13e0476c-9433-4b16-a028-f3e8ec41a628 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:46.941143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-33584b98-303f-41d1-84ef-d543a110fc01 req-13e0476c-9433-4b16-a028-f3e8ec41a628 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:46.950757 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-33584b98-303f-41d1-84ef-d543a110fc01 req-13e0476c-9433-4b16-a028-f3e8ec41a628 service nova] Creating event network-vif-plugged:63dcea29-ad70-42db-bd2d-65baa87be113 for instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 on hv-cinder-84727 Jun 23 09:28:46.958072 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-33584b98-303f-41d1-84ef-d543a110fc01 req-13e0476c-9433-4b16-a028-f3e8ec41a628 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Jun 23 09:28:46.958582 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 288/581] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:47.185553 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:47.186169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:47.192696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:47.193156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:47.193913 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:47.194345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:47.254022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:47.261808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7a4cbb53-fe5d-47db-a4f4-b1ff0ac4aa0a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1262 microversion: 2.1 time: 0.080614 Jun 23 09:28:47.262402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 294/582] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:47 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:47.444860 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:47.445555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:47.452116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:47.452559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:47.453307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:47.453735 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:47.581732 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:47.590093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-74a7acec-68a2-4410-98a9-6f8eeaede452 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1689 microversion: 2.1 time: 0.149570 Jun 23 09:28:47.590666 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 289/583] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:47 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:47.815933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:47.816542 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:47.822484 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:47.822932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:47.824220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:47.824652 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:47.950543 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:47.957864 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0cd59140-0cb7-4d62-a8cb-66c359bc993d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.145730 Jun 23 09:28:47.958419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 295/584] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:47 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:48.279940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:48.280557 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:48.286975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:48.287428 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:48.288183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:48.288615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:48.352043 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:48.359433 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-644216c2-172d-41ee-8181-bc63aefe9722 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1262 microversion: 2.1 time: 0.083834 Jun 23 09:28:48.359991 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 290/585] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:48 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:48.611001 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:48.611632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:48.628693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:48.629144 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:48.629986 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:48.630588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:48.777101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:48.784830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d9643b16-8f4d-4701-912b-c889fd4d2565 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1689 microversion: 2.1 time: 0.181699 Jun 23 09:28:48.785376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 296/586] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:48 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:48.975352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:48.976068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:48.983004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:48.983466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:48.985075 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:48.985785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:49.152069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:49.159902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f771fd56-4c0b-4975-aa32-f8f78691bd36 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1368 microversion: 2.1 time: 0.188596 Jun 23 09:28:49.160467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 291/587] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:48 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:49.376715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:49.377343 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:49.384117 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:49.384568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:49.385374 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:49.385832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:49.453755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:49.461755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a720a5bc-a67d-4358-9672-e07e053bba93 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1310 microversion: 2.1 time: 0.088927 Jun 23 09:28:49.462442 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 297/588] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:49 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:49.728494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-04eb9804-6d44-4ac5-8d30-3762bfbfeed5 req-be646fa1-3dad-4029-a36c-50c2bb0c1ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65478370-c27f-44f4-a45f-0a5f2bc0dbe9", "name": "network-vif-deleted", "tag": "d80dcfb6-742d-4015-9492-0b79f1b71413"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:49.737847 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-04eb9804-6d44-4ac5-8d30-3762bfbfeed5 req-be646fa1-3dad-4029-a36c-50c2bb0c1ff3 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:49.738290 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-04eb9804-6d44-4ac5-8d30-3762bfbfeed5 req-be646fa1-3dad-4029-a36c-50c2bb0c1ff3 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:49.749307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-04eb9804-6d44-4ac5-8d30-3762bfbfeed5 req-be646fa1-3dad-4029-a36c-50c2bb0c1ff3 service nova] Creating event network-vif-deleted:d80dcfb6-742d-4015-9492-0b79f1b71413 for instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 on hv-cinder-84727 Jun 23 09:28:49.754120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-04eb9804-6d44-4ac5-8d30-3762bfbfeed5 req-be646fa1-3dad-4029-a36c-50c2bb0c1ff3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029281 Jun 23 09:28:49.754702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 292/589] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:49.802185 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:49.802863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:49.809437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:49.809880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:49.810639 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:49.811109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:49.872452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:49.880075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6fc2ab64-421d-403d-a665-132f67a9c8d8 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1621 microversion: 2.1 time: 0.082318 Jun 23 09:28:49.880819 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 298/590] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:49 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1621 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:50.177893 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:50.178595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:50.185365 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.185800 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.186567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.187031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.316701 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:50.320198 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:50.325397 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-82d887ea-5e2e-454d-a2b1-95ea535b1fac tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1558 microversion: 2.1 time: 0.151764 Jun 23 09:28:50.329479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 293/591] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:50 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:50.341489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:50.341988 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:50.348157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.348611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.349391 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.349829 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.428194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-292a1027-04d5-4fb6-b6c5-85e47fcebf80 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090548 Jun 23 09:28:50.428795 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 299/592] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:28:50 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:50.481711 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:50.482330 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:50.490058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.490509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.491317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.491762 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.554629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:50.569017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b124b39e-5743-4d0c-b577-4a4acd91085d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1318 microversion: 2.1 time: 0.092454 Jun 23 09:28:50.584721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 294/593] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:50 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:50.897933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:50.899420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:50.905691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.906255 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.907160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.907691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.941670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:50.942430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:50.943101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'fault' on Instance uuid 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:28:51.014932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:51.025570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-45beadc4-f4ec-46ff-9305-c907e48a11c9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 200 len: 1335 microversion: 2.1 time: 0.131804 Jun 23 09:28:51.030529 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 300/594] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:50 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:51.600018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:51.601334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:51.620644 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:51.621206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:51.622059 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:51.623362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:51.734032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-0d8f4dd1-33c8-49d6-b18c-1f43be8c9df0 req-d2330a88-9cc5-44ad-9fa7-121a6503a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e58a13-6ee6-4d01-840f-50a6cc456fb9", "tag": "63dcea29-ad70-42db-bd2d-65baa87be113"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:51.748595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-0d8f4dd1-33c8-49d6-b18c-1f43be8c9df0 req-d2330a88-9cc5-44ad-9fa7-121a6503a4cc service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:51.751459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-0d8f4dd1-33c8-49d6-b18c-1f43be8c9df0 req-d2330a88-9cc5-44ad-9fa7-121a6503a4cc service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:51.782686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-0d8f4dd1-33c8-49d6-b18c-1f43be8c9df0 req-d2330a88-9cc5-44ad-9fa7-121a6503a4cc service nova] Creating event network-changed:63dcea29-ad70-42db-bd2d-65baa87be113 for instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 on hv-cinder-84727 Jun 23 09:28:51.795434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-0d8f4dd1-33c8-49d6-b18c-1f43be8c9df0 req-d2330a88-9cc5-44ad-9fa7-121a6503a4cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065240 Jun 23 09:28:51.797845 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 301/595] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:28:51.899402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:51.920531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-73871356-759b-49bf-a4c1-6f2589f7f8f4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.328846 Jun 23 09:28:51.929398 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 295/596] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:51 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:52.044027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:52.045472 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: 65478370-c27f-44f4-a45f-0a5f2bc0dbe9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:52.059207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:52.062377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:52.063619 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:52.065964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:52.099718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] HTTP exception thrown: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 could not be found. Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Request method failure captured: Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 HTTP/1.1 Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDEzg9sac6w2TmnHl3QCOiv3EI8SyhHECSSQh1A_NSxH37E0bYlp251nhzcT1WsvKjQpRhQQEJLyzjcaUluEGWysd1ORnr4SUf6fqsB3wJnVn2BTqCxv_8lGQonkM8VpP0x5Ml-ydKCbKjiWjefMJECQgfmqSwmNd_ndi8ZTgzcyCVg Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:28:52.110696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_368a6f8fbca64e7791d5330f0a99d086", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 29fe5fb181e2452388d24fd0b7aa5e9f Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 could not be found. Jun 23 09:28:52.112488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '65478370-c27f-44f4-a45f-0a5f2bc0dbe9'} Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 could not be found. Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:28:52.113473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 could not be found. Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 could not be found. Jun 23 09:28:52.115115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:28:52.116490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Returning 404 to user: Instance 65478370-c27f-44f4-a45f-0a5f2bc0dbe9 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:28:52.116490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-918de29d-41e1-4bf5-bc34-90cffacf4299 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9" status: 404 len: 111 microversion: 2.1 time: 0.068131 Jun 23 09:28:52.117164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f57f502d-981b-4a93-ac07-0a675e0d3d73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '.version_select at 0x7f8270a621f0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:52.129720 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 302/597] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:52 2022] GET /compute/v2.1/servers/65478370-c27f-44f4-a45f-0a5f2bc0dbe9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:28:52.265119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f57f502d-981b-4a93-ac07-0a675e0d3d73 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783668015" status: 202 len: 0 microversion: 2.1 time: 0.151846 Jun 23 09:28:52.265906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 296/598] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783668015 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:28:52.602281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:52.604005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:52.616083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:52.616532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:52.617319 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:52.621412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:52.682847 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d0e86e04-06a4-494d-b0d6-1b1fb4d0bb18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/ips" status: 200 len: 151 microversion: 2.20 time: 0.085716 Jun 23 09:28:52.685942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 303/599] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Jun 23 09:28:52 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/ips => generated 151 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:28:52.940985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:52.944457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:52.956694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:52.958382 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:52.961350 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:52.966120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:53.464828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:53.480475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-507a2880-440c-40fa-a56d-677458e5ee2b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.544232 Jun 23 09:28:53.481562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 297/600] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:52 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:53.918022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-145d922d-aad2-4977-be93-68009bcd73f6 req-a92e3432-2d52-426e-a1a7-f6f9a17e7974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:53.949801 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-145d922d-aad2-4977-be93-68009bcd73f6 req-a92e3432-2d52-426e-a1a7-f6f9a17e7974 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:53.950456 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-145d922d-aad2-4977-be93-68009bcd73f6 req-a92e3432-2d52-426e-a1a7-f6f9a17e7974 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:53.966549 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-145d922d-aad2-4977-be93-68009bcd73f6 req-a92e3432-2d52-426e-a1a7-f6f9a17e7974 service nova] Creating event network-changed:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:28:53.972606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-145d922d-aad2-4977-be93-68009bcd73f6 req-a92e3432-2d52-426e-a1a7-f6f9a17e7974 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059248 Jun 23 09:28:53.975937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 304/601] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:28:54.498020 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:54.499060 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:54.502478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=10 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:54.508590 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:54.509079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:54.510103 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:54.511136 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:54.659247 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:54.669615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a5163336-b787-4002-935e-c602cc5c2be8 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.175630 Jun 23 09:28:54.675348 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 298/602] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:54 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:55.685678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:55.693169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:55.694343 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:55.713594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:55.714306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:55.715371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:55.716070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:55.871305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:28:55.872742 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:55.880881 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:55.881334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:55.882104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:55.882532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:55.916165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lazy-loading 'flavor' on Instance uuid 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:28:55.945391 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:55.955830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d74ae326-012a-4408-b71d-7438b2f71ae5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.271724 Jun 23 09:28:55.956575 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 305/603] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:55 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:56.618402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1f8f66b2-a57d-4c42-8dc5-3fcb6c1f72cf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/action" status: 202 len: 0 microversion: 2.20 time: 0.752375 Jun 23 09:28:56.622591 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 299/604] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jun 23 09:28:55 2022] POST /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 09:28:56.627858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:56.628469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:56.630353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=16 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:56.635487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:56.636131 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:56.637221 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:56.637739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:56.728268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:56.728866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:56.737854 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:56.738313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:56.739137 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:56.739688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:56.768589 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:28:56.809057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:56.817692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:56.819443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:56.820746 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a875c34d-957e-4822-95a2-f346729510a9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.196831 Jun 23 09:28:56.821303 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 306/605] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:56 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:56.976073 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:56.976784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:56.985079 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:56.986246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:56.987115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:56.987731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:57.147018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:57.166407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f88c43be-9215-4df9-b4cd-a0b4c52310d2 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.184921 Jun 23 09:28:57.166407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 307/606] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:56 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:57.172246 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f51ba95e-b640-4218-b780-1943c19fcf0e tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 204 len: 0 microversion: 2.1 time: 0.448333 Jun 23 09:28:57.172861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 300/607] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:28:56 2022] DELETE /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 09:28:57.182094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:57.186371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:57.192399 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:57.192857 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:57.193641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:57.194081 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:57.338721 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:57.346953 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-eecbbdbd-e26c-4adf-8e65-c3e694e3454f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1509 microversion: 2.1 time: 0.169895 Jun 23 09:28:57.352950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 308/608] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:57 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:57.840943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:57.841636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:57.849237 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:57.850625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:57.856820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:57.857343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:58.017185 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:58.026605 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:58.028883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:58.030322 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-aec2a43e-d65f-40c4-9020-1c88f82df308 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.193841 Jun 23 09:28:58.031423 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 301/609] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:57 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:58.174679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:58.175999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:58.184978 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:58.185428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:58.186231 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:58.186665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:58.191765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:28:58.330023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:58.338217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c0f91701-570b-43f9-b88a-c24b8a53196a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.167801 Jun 23 09:28:58.348370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 309/610] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:58 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:58.364920 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:58.365524 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:58.372098 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:58.372552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:58.373545 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:58.374156 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:58.530898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:58.539532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7e188026-9b3c-4825-a3a9-55dc77dde394 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1509 microversion: 2.1 time: 0.178677 Jun 23 09:28:58.540623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 302/611] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:58 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:28:59.049505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:59.050816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:59.061780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:59.072017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:59.072017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:59.072017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:59.226738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:59.235633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:59.237129 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:59.238283 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8d166b37-2d5f-4472-824e-e76608bcec6e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.193127 Jun 23 09:28:59.239086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 310/612] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:28:59 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:28:59.356030 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:59.357225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:59.365089 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:59.366392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:59.367721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:59.368255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:59.517367 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:59.528078 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ddb9fe77-8ff7-4040-9627-bdd8c4ff636a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.175875 Jun 23 09:28:59.537922 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 303/613] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:59 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:28:59.559998 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:28:59.560724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:28:59.566805 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:59.567281 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:59.568054 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:28:59.568486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:28:59.699040 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:28:59.707090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2e8cb2f3-434d-4993-a1d5-4d4b40244a72 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1509 microversion: 2.1 time: 0.152276 Jun 23 09:28:59.707651 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 311/614] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:28:59 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:00.257274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:00.257891 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:00.264004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:00.264453 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:00.265304 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:00.265745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:00.432463 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:00.444562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:00.446080 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:00.447316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cd88f950-1db0-44ef-8231-63b2e98f617a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.194194 Jun 23 09:29:00.448380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 304/615] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:00 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:00.544456 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:00.545082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:00.551206 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:00.551654 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:00.552415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:00.552850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:00.684074 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:00.691502 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ba584655-759f-4161-8dbf-0a8caa25bfa3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.150975 Jun 23 09:29:00.692051 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 312/616] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:00 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:00.726685 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:00.727341 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:00.735655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:00.736114 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:00.736886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:00.737324 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:00.865676 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:00.873648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bbedda0a-e809-4eda-9afd-dd98223e71b3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1509 microversion: 2.1 time: 0.152325 Jun 23 09:29:00.874223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 305/617] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:00 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:01.570095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:01.570711 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:01.576874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:01.577321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:01.578082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:01.578519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:01.705821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:01.709151 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:01.709772 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:01.714574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:01.716104 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:01.716801 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:01.717255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:01.717380 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7533eccc-c66f-402b-8ed6-295d3703034b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.255651 Jun 23 09:29:01.717809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 313/618] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:01 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:01.723569 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:01.723569 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:01.845139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:01.852479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-70901e56-4807-4036-904c-8e34c6bae08b tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.147229 Jun 23 09:29:01.853041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 306/619] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:01 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:01.889731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:01.890337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:01.896216 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:01.896674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:01.897399 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:01.897826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:02.025227 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:02.033121 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7ad23cd7-0f73-4991-ad9a-2e2c3adc4033 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1509 microversion: 2.1 time: 0.147644 Jun 23 09:29:02.033685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 314/620] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:01 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:02.739597 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:02.745840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:02.748950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:02.749416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:02.750202 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:02.750642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:02.869993 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:02.871999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:02.879910 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:02.880290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:02.881188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:02.881735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:02.968908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:02.972714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:02.977809 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:02.980479 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:02.982580 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1535e327-2d4b-49c2-b077-b4699b4e5f53 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.249507 Jun 23 09:29:02.991691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 307/621] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:02 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:03.050075 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:03.050795 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:03.057768 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:03.058223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:03.059030 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:03.059845 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:03.268035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:03.276696 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9b2028de-9319-408a-a001-8a72cddcd779 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1509 microversion: 2.1 time: 0.229805 Jun 23 09:29:03.277650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 308/622] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:03 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:03.393605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:03.401477 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4c8d6180-6c0c-491e-bd50-820184c54551 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.535734 Jun 23 09:29:03.402109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 315/623] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:02 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:03.859268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-51e0d94e-6002-44c9-b9ac-f613c2f7431a req-146f7c82-b135-4e4e-b07f-70bdc98dd2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead81496-995d-41ce-8a52-0c61545053f7", "name": "network-vif-deleted", "tag": "3ed4c870-26d7-4fa7-9842-6dc0b9ff1906"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:03.868188 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-51e0d94e-6002-44c9-b9ac-f613c2f7431a req-146f7c82-b135-4e4e-b07f-70bdc98dd2ea service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:03.868713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-51e0d94e-6002-44c9-b9ac-f613c2f7431a req-146f7c82-b135-4e4e-b07f-70bdc98dd2ea service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:03.880006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-51e0d94e-6002-44c9-b9ac-f613c2f7431a req-146f7c82-b135-4e4e-b07f-70bdc98dd2ea service nova] Creating event network-vif-deleted:3ed4c870-26d7-4fa7-9842-6dc0b9ff1906 for instance ead81496-995d-41ce-8a52-0c61545053f7 on hv-cinder-84727 Jun 23 09:29:03.885240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-51e0d94e-6002-44c9-b9ac-f613c2f7431a req-146f7c82-b135-4e4e-b07f-70bdc98dd2ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029599 Jun 23 09:29:03.885929 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 309/624] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:04.001312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:04.001950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:04.008595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:04.008982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:04.009738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:04.010171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:04.233010 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:04.245233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:04.246780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:04.248023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d18e6959-f9a1-4144-a6eb-97000917fe35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.250611 Jun 23 09:29:04.259096 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 316/625] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:03 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:04.294937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:04.295655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:04.302051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:04.302504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:04.303302 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:04.303741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:04.371610 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:04.517067 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cad461ef-5f68-4040-aa15-44bbcea3cbc9 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1293 microversion: 2.1 time: 0.092133 Jun 23 09:29:04.517067 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 310/626] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:04 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:04.517600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:04.517600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:04.517600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:04.517600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:04.517955 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:04.517955 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:04.563585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:04.570961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6b8bb958-97c3-43a9-9eb4-ab2978ff784f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.156726 Jun 23 09:29:04.571516 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 317/627] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:04 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:05.265532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:05.266170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:05.272788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.273240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.273998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.274432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.406670 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:05.414522 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:05.416063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:05.417836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2e5a774d-f8a6-4ae6-bf9c-854f1d57a201 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.156212 Jun 23 09:29:05.418398 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 311/628] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:05 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:05.531855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:05.532499 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:05.538459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.538903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.539697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.540132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.570439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.570887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.571361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'fault' on Instance uuid ead81496-995d-41ce-8a52-0c61545053f7 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:29:05.588060 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:05.589309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:05.595373 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.595827 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.596633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:05.597076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:05.620006 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:05.627557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0e94ee03-1249-4b37-85b5-c03e5ceb98ad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1312 microversion: 2.1 time: 0.198022 Jun 23 09:29:05.631892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 318/629] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:05 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:05.722403 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:05.729869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1ded3986-120b-49b2-baa4-d13e879acffa tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.146112 Jun 23 09:29:05.730431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 312/630] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:05 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:06.435882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:06.436389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:06.442981 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.443425 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.444181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.444609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.572861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:06.580713 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:06.582223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:06.583408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-455efd3f-ccbf-4cd2-8ee7-cf93bc3ea06b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.151496 Jun 23 09:29:06.583958 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 319/631] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:06 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:06.647206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:06.647845 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:06.654415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.657888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.657888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.657888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.686749 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.687150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.687639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'fault' on Instance uuid ead81496-995d-41ce-8a52-0c61545053f7 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:29:06.726957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:06.734841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-238ea851-24e5-435b-9912-3efa7d3c61c4 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 200 len: 1312 microversion: 2.1 time: 0.091525 Jun 23 09:29:06.735431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 313/632] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:06 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:06.746583 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:06.747232 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:06.753259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.753710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.754469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:06.754960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:06.888974 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:06.896495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ac903a3e-1fa4-4148-9daf-83c004f1bb3c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.153653 Jun 23 09:29:06.900058 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 320/633] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:06 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:07.601405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:07.602238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:07.604110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:07.609545 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.611340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.611340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.611593 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.751628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:07.752366 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: ead81496-995d-41ce-8a52-0c61545053f7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:07.754271 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:07.759463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.759921 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.760706 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.761141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.762874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:07.764442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:07.765648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bf4dad29-8786-4142-8d96-112a7c742d75 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.168196 Jun 23 09:29:07.766232 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 314/634] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:07 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:07.776353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] HTTP exception thrown: Instance ead81496-995d-41ce-8a52-0c61545053f7 could not be found. Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Request method failure captured: Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 HTTP/1.1 Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDEzg9sac6w2TmnHl3QCOiv3EI8SyhHECSSQh1A_NSxH37E0bYlp251nhzcT1WsvKjQpRhQQEJLyzjcaUluEGWysd1ORnr4SUf6fqsB3wJnVn2BTqCxv_8lGQonkM8VpP0x5Ml-ydKCbKjiWjefMJECQgfmqSwmNd_ndi8ZTgzcyCVg Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:29:07.778004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_368a6f8fbca64e7791d5330f0a99d086", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 29fe5fb181e2452388d24fd0b7aa5e9f Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance ead81496-995d-41ce-8a52-0c61545053f7 could not be found. Jun 23 09:29:07.779742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'ead81496-995d-41ce-8a52-0c61545053f7'} Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead81496-995d-41ce-8a52-0c61545053f7 could not be found. Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:29:07.780699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead81496-995d-41ce-8a52-0c61545053f7 could not be found. Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead81496-995d-41ce-8a52-0c61545053f7 could not be found. Jun 23 09:29:07.782152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:29:07.783340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Returning 404 to user: Instance ead81496-995d-41ce-8a52-0c61545053f7 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:29:07.783340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-05959907-e047-428f-b67d-29429dc7c7bd tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7" status: 404 len: 111 microversion: 2.1 time: 0.031655 Jun 23 09:29:07.783340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 321/635] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:07 2022] GET /compute/v2.1/servers/ead81496-995d-41ce-8a52-0c61545053f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:29:07.788876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:07.789380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:07.796119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.796574 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.797350 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.797792 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.821979 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:29:07.912678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:07.913211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:07.919390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.919846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:07.920604 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:07.921044 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:08.052883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:08.060286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9adfedd2-4d78-442d-ab31-d202b0bc83f3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.151742 Jun 23 09:29:08.060875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 322/636] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:07 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:08.125747 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c29bb3b3-4a79-45a7-bcd4-d51744139114 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 204 len: 0 microversion: 2.1 time: 0.340298 Jun 23 09:29:08.126337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 315/637] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:29:07 2022] DELETE /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:29:08.134419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:08.135577 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:08.142026 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:08.142475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:08.143276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:08.143718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:08.271460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:08.278948 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fbf78210-24be-4e87-af55-65ced540bbad tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.148309 Jun 23 09:29:08.279493 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 323/638] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:08 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:08.787433 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:08.788136 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:08.794929 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:08.795385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:08.796141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:08.796577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:08.924977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:08.933965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:08.935495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:08.936671 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2667399f-f734-4c64-b9b5-402b3682a3d6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.153444 Jun 23 09:29:08.937247 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 316/639] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:08 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:09.077545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:09.078173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:09.080492 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:09.085128 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:09.087012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:09.087012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:09.087012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:09.221049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:09.230194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-faa6242e-87a5-4ed0-9676-b2a5e2660394 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.155542 Jun 23 09:29:09.230194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 324/640] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:09 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:09.296449 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:09.297057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:09.303266 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:09.303715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:09.304472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:09.304902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:09.436165 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:09.443591 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-deaa6c2d-be85-403b-aca1-21975a92334f tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.150976 Jun 23 09:29:09.444157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 317/641] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:09 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:09.954784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:09.955414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:09.961931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:09.962371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:09.963187 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:09.963618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:10.090739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:10.099273 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:10.100815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:10.101947 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-06838a7c-6709-41e4-a2c1-fc4472166952 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.151070 Jun 23 09:29:10.102491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 325/642] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:09 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:10.246132 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:10.246670 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:10.253271 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:10.253714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:10.254462 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:10.254888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:10.378470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:10.386542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-49a6d972-c531-44e1-889e-a65b0159fbf9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.144964 Jun 23 09:29:10.387145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 318/643] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:10 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:10.460272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:10.460941 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:10.466890 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:10.467360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:10.468108 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:10.473792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:10.473792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:10.597688 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:10.605501 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-621595bd-df73-416e-a93d-0c907f033719 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.149052 Jun 23 09:29:10.606070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 326/644] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:10 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:11.121729 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:11.122250 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:11.128221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.128666 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.129468 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.129901 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.214491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-defc328b-f561-44c0-a944-3e6e5d2af51a req-c7b4dae9-6e49-4431-9fca-4f3de8c2c26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "name": "network-vif-plugged", "status": "completed", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:11.222765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-defc328b-f561-44c0-a944-3e6e5d2af51a req-c7b4dae9-6e49-4431-9fca-4f3de8c2c26b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.223243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-defc328b-f561-44c0-a944-3e6e5d2af51a req-c7b4dae9-6e49-4431-9fca-4f3de8c2c26b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.235139 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-defc328b-f561-44c0-a944-3e6e5d2af51a req-c7b4dae9-6e49-4431-9fca-4f3de8c2c26b service nova] Creating event network-vif-plugged:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:29:11.240487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-defc328b-f561-44c0-a944-3e6e5d2af51a req-c7b4dae9-6e49-4431-9fca-4f3de8c2c26b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 Jun 23 09:29:11.241120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 327/645] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:11.265793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:11.273978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:11.275512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:11.277256 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-be43b784-5b30-4538-ab78-93b0d00dcae9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.159661 Jun 23 09:29:11.277256 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 319/646] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:11 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:11.404077 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:11.404787 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:11.411501 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.412066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.412880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.413312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.615703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:11.623286 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:11.623892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:11.628864 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5a8ec642-ba22-46fd-9855-43b62dbc5856 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.228957 Jun 23 09:29:11.630272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 328/647] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:11 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:11.640248 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.640797 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.641664 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:11.642159 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:11.774197 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:11.782449 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-53de98dc-6564-4cfa-b3b2-9dae4bc6033d tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1521 microversion: 2.1 time: 0.163550 Jun 23 09:29:11.783294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 320/648] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:11 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:12.145836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-6a2e91c9-596e-4b97-97df-16571cc34f13 req-258e06ad-69aa-4404-8a60-5f6dc649eaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4921354-594f-4b15-b3f2-47a3d838f851", "name": "network-vif-deleted", "tag": "4945a4dc-aecf-48ce-bab1-065123f856ba"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:12.154689 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-6a2e91c9-596e-4b97-97df-16571cc34f13 req-258e06ad-69aa-4404-8a60-5f6dc649eaaf service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.155216 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-6a2e91c9-596e-4b97-97df-16571cc34f13 req-258e06ad-69aa-4404-8a60-5f6dc649eaaf service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.165967 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-6a2e91c9-596e-4b97-97df-16571cc34f13 req-258e06ad-69aa-4404-8a60-5f6dc649eaaf service nova] Creating event network-vif-deleted:4945a4dc-aecf-48ce-bab1-065123f856ba for instance d4921354-594f-4b15-b3f2-47a3d838f851 on hv-cinder-84727 Jun 23 09:29:12.171398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-6a2e91c9-596e-4b97-97df-16571cc34f13 req-258e06ad-69aa-4404-8a60-5f6dc649eaaf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029453 Jun 23 09:29:12.172609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 329/649] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:12.296575 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:12.297222 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:12.303746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.304146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.304908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.305340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.433291 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:12.441531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:12.443080 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:12.444279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-90e1e347-495d-4f5a-9981-bc4212661cb3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.151633 Jun 23 09:29:12.444846 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 321/650] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:12 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:12.647058 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:12.647755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:12.654416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.654862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.655639 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.656070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.782323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:12.789600 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d1c0bb93-8a82-4512-a330-7e0352f31b22 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1358 microversion: 2.1 time: 0.147398 Jun 23 09:29:12.790162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 330/651] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:12 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:12.801602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:12.802285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:12.808882 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.809265 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.810022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:12.810452 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:12.876170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:12.884033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5fa27d19-ac08-4874-99dc-55e236b1bad3 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1306 microversion: 2.1 time: 0.086480 Jun 23 09:29:12.884604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 322/652] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:12 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:13.462771 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:13.463991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:13.470191 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.474799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.474799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.474799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.632485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:13.640355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:13.641861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:13.643036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-32320793-5aa0-467f-bc1d-b0748331b71a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1744 microversion: 2.20 time: 0.184293 Jun 23 09:29:13.643587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 331/653] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:13 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:13.805940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:13.807016 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:13.813245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.813692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.814470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.814882 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.819171 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:13.902208 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:13.902827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:13.914691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.915243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.916023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.916563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.953865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:13.956063 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.956610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:13.957068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lazy-loading 'fault' on Instance uuid d4921354-594f-4b15-b3f2-47a3d838f851 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:29:13.962868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0d79dab5-444e-4a07-add0-a3d1a7d3cedf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1549 microversion: 2.1 time: 0.160847 Jun 23 09:29:13.964318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 323/654] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:13 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:13.987445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:13.991694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:13.998871 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:13.999385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.000177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.000592 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.009656 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fe5fb181e2452388d24fd0b7aa5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368a6f8fbca64e7791d5330f0a99d086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.019462 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f0fd361e-6f4b-4806-b214-7d4d8a231277 tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 200 len: 1311 microversion: 2.1 time: 0.122493 Jun 23 09:29:14.020641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 332/655] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:13 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:14.138116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.146047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-809c0c3b-ef23-45cf-ae11-ae871f4e2951 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1549 microversion: 2.1 time: 0.162720 Jun 23 09:29:14.146702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 324/656] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:13 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:14.167438 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:14.170843 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.171620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Searching by: {'deleted': False, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9'} {{(pid=118500) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 09:29:14.178211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.178647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.179500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.179924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.266711 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.multi_cell_list [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118500) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 09:29:14.357132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3ba0292b-ee05-42c6-8ff2-bd40c8b2ff9c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.193339 Jun 23 09:29:14.357605 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 333/657] 10.222.0.52 () {58 vars in 1124 bytes} [Thu Jun 23 09:29:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:14.368077 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:14.368691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:14.375312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.379282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.379282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.379282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.503861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.511785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-61a8b43c-1898-43c3-b1dd-7d916e20ec06 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1549 microversion: 2.1 time: 0.147615 Jun 23 09:29:14.512343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 325/658] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:14 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:14.660955 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:14.661479 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:14.667415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.667865 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.668607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:14.669037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:14.804667 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.812841 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.814450 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:14.815736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-722d067f-1687-4064-bf53-ee397591f342 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1744 microversion: 2.20 time: 0.158829 Jun 23 09:29:14.816293 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 334/659] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:14 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:15.037000 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:15.037609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] [instance: d4921354-594f-4b15-b3f2-47a3d838f851] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:15.044305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:15.044755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:15.045515 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:15.045946 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:15.060095 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] HTTP exception thrown: Instance d4921354-594f-4b15-b3f2-47a3d838f851 could not be found. Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Request method failure captured: Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 HTTP/1.1 Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDEzg9sac6w2TmnHl3QCOiv3EI8SyhHECSSQh1A_NSxH37E0bYlp251nhzcT1WsvKjQpRhQQEJLyzjcaUluEGWysd1ORnr4SUf6fqsB3wJnVn2BTqCxv_8lGQonkM8VpP0x5Ml-ydKCbKjiWjefMJECQgfmqSwmNd_ndi8ZTgzcyCVg Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:29:15.061796 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/368a6f8fbca64e7791d5330f0a99d086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_368a6f8fbca64e7791d5330f0a99d086", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 368a6f8fbca64e7791d5330f0a99d086 Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456797523 Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 29fe5fb181e2452388d24fd0b7aa5e9f Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456797523-project Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance d4921354-594f-4b15-b3f2-47a3d838f851 could not be found. Jun 23 09:29:15.063496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'd4921354-594f-4b15-b3f2-47a3d838f851'} Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4921354-594f-4b15-b3f2-47a3d838f851 could not be found. Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:29:15.064439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4921354-594f-4b15-b3f2-47a3d838f851 could not be found. Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4921354-594f-4b15-b3f2-47a3d838f851 could not be found. Jun 23 09:29:15.065985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:15.071507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] Returning 404 to user: Instance d4921354-594f-4b15-b3f2-47a3d838f851 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:29:15.071507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7f9c464c-610c-4123-ab1f-f15e2ab9260c tempest-ServerRescueNegativeTestJSON-456797523 tempest-ServerRescueNegativeTestJSON-456797523-project] 10.222.0.52 "GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851" status: 404 len: 111 microversion: 2.1 time: 0.030035 Jun 23 09:29:15.071507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 326/660] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:15 2022] GET /compute/v2.1/servers/d4921354-594f-4b15-b3f2-47a3d838f851 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:29:15.833961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:15.834692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:15.841998 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:15.842453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:15.843314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:15.843757 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:15.974036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:15.982014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:15.983527 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:15.984665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f471db2b-1764-4f51-a2d6-507fb7d7e8f2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1744 microversion: 2.20 time: 0.154757 Jun 23 09:29:15.985219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 335/661] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:15 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:16.415934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca7603d2-e70c-4983-9ffb-e35c74b7cc51"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:16.415934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:16.415934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:16.415934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:16.418716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:16.419195 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:17.003205 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:17.003871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:17.023412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:17.026679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:17.026679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:17.026679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:17.256750 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:17.281188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:17.285802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:17.295845 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f6a26a58-f3ee-46b7-8b58-8b25c16f9817 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.296365 Jun 23 09:29:17.296441 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 336/662] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:16 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:17.301132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-a1340082-e6ca-40a5-b3e3-fdc98a1cc223 req-be639997-b914-489b-8c97-10fe9ef69c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "name": "network-vif-plugged", "status": "completed", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:17.320519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-a1340082-e6ca-40a5-b3e3-fdc98a1cc223 req-be639997-b914-489b-8c97-10fe9ef69c0c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:17.320952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-a1340082-e6ca-40a5-b3e3-fdc98a1cc223 req-be639997-b914-489b-8c97-10fe9ef69c0c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:17.332882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-a1340082-e6ca-40a5-b3e3-fdc98a1cc223 req-be639997-b914-489b-8c97-10fe9ef69c0c service nova] Creating event network-vif-plugged:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:29:17.338157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-a1340082-e6ca-40a5-b3e3-fdc98a1cc223 req-be639997-b914-489b-8c97-10fe9ef69c0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040297 Jun 23 09:29:17.339063 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 337/663] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:17.339504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cf8a96db-8a02-4027-ab07-809bded3e2f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937641 Jun 23 09:29:17.347012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 327/664] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:29:16 2022] POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:18.324225 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:18.325727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:18.339664 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:18.340121 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:18.341026 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:18.341475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:18.529397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:18.540161 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:18.543271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:18.545575 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0494fe5e-f613-44fb-8c80-3374e50228e1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.227935 Jun 23 09:29:18.551308 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 338/665] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:18 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:19.565975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:19.567370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:19.574978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:19.579111 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:19.579111 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:19.579111 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:19.841164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:19.855141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:19.856866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:19.858301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4c9c2c7e-eef2-469b-969f-ffb662e9ea18 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.297299 Jun 23 09:29:19.870983 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 328/666] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:19 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:20.878164 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:20.878782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:20.885507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:20.886202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:20.886994 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:20.887450 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:21.032283 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:21.040409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:21.041888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:21.045495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-dd76fa6c-7004-422b-bbd8-4e6a966d15c5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.169527 Jun 23 09:29:21.045495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 339/667] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:20 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:22.061544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:22.062155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:22.077418 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:22.077870 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:22.078656 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:22.079130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:22.256516 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:22.269866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:22.271551 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:22.273040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c4d8c893-7de6-4f57-9784-9ff6162b9733 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.215549 Jun 23 09:29:22.273804 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 329/668] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:22 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:23.300230 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:23.305967 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:23.313613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:23.314396 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:23.315241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:23.315834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:23.543239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:23.552388 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:23.554303 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:23.555885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8b0d5fff-a980-43b8-8404-19e81d922f23 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.262877 Jun 23 09:29:23.556454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 340/669] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:23 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:24.575157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:24.576224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:24.592509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:24.593217 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:24.594179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:24.594786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:24.808019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:24.830168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:24.831721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:24.832933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6a28ee50-3fef-4bc7-96bc-becdc80e71c3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.262529 Jun 23 09:29:24.852743 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 330/670] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:24 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:25.852808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:25.855693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:25.879946 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:25.892907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:25.893362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:25.894134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:25.894999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:26.139701 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:26.141481 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:26.152086 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:26.152819 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:26.153678 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:26.154274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:26.192644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:26.201054 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:26.208317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:26.209846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-68efd1ed-c2a8-4e5d-8473-001f35b2104c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.362310 Jun 23 09:29:26.214324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 341/671] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:25 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:26.347445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:26.357688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9170fb1c-bfa7-4ae7-8703-25aac830edfe tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1595 microversion: 2.1 time: 0.223261 Jun 23 09:29:26.358269 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 331/672] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:26 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1595 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:27.231586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:27.232776 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:27.245823 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:27.248468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:27.249509 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:27.249945 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:27.492309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:27.503917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:27.526302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:27.527587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ec49634a-c7a9-4076-b326-1e95ab9efd35 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.301938 Jun 23 09:29:27.535338 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 342/673] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:27 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:28.548255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:28.554195 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:28.571641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:28.576859 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:28.576859 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:28.577914 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:28.837437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:28.855478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:28.861425 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:28.863877 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-01854be1-2641-4b4c-848e-780eb7d825d9 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.319519 Jun 23 09:29:28.877682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 332/674] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:28 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:29.504121 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:29.505467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:29.513292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:29.514257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:29.515187 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:29.515857 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:29.544097 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-bf3a5cd2-a983-4dc8-897d-df2391106d69 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/ips" status: 200 len: 150 microversion: 2.1 time: 0.044014 Jun 23 09:29:29.562994 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 343/675] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:29:29 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:29.901554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:29.901554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:29.915810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:29.919758 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:29.920615 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:29.921067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:30.006472 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:30.132721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-faf74a21-aef4-4f37-90b5-64a5a19a9c95 req-7f92fa8e-b45e-4dd3-8915-e934992e9a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:30.145317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-faf74a21-aef4-4f37-90b5-64a5a19a9c95 req-7f92fa8e-b45e-4dd3-8915-e934992e9a30 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:30.145980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-faf74a21-aef4-4f37-90b5-64a5a19a9c95 req-7f92fa8e-b45e-4dd3-8915-e934992e9a30 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:30.169722 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-faf74a21-aef4-4f37-90b5-64a5a19a9c95 req-7f92fa8e-b45e-4dd3-8915-e934992e9a30 service nova] Creating event network-changed:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:29:30.179623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-faf74a21-aef4-4f37-90b5-64a5a19a9c95 req-7f92fa8e-b45e-4dd3-8915-e934992e9a30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305160 Jun 23 09:29:30.183286 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 333/676] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:30.328435 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:30.339923 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:30.344000 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:30.348846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-52a0864c-4488-46b8-9d36-ac90a9f7b89c tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1739 microversion: 2.20 time: 0.463845 Jun 23 09:29:30.349987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 344/677] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:29 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1739 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:30.824982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b7d3ff8d-66b9-44bb-ac84-88b9a181a9f0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: .version_select at 0x7f8270b0eb80>, body: {"keypair": {"name": "tempest-keypair-2111862993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhd3WWbG83ayjcseV8YqHcJsWY+ug3rAN+LCCiBpDQET+3q7M72y8U7tQyolasnKUsXJea1twsueEwU5XQq/26IVPPHKPe6VSoDxYTFtwh5MrqL4DDEiMPgcXUWGPpd5w=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:30.859245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-b7d3ff8d-66b9-44bb-ac84-88b9a181a9f0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:29:30.867471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-b7d3ff8d-66b9-44bb-ac84-88b9a181a9f0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for user 9f0d4416e74a4126a6aa1ccf58e22ee3 and project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:29:30.979725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b7d3ff8d-66b9-44bb-ac84-88b9a181a9f0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276260 Jun 23 09:29:30.981069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 334/678] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:29:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:31.376076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:31.376076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:31.378644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:31.379192 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:31.380216 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:31.380897 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:31.592772 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733bf5a3-701f-44e9-9b24-fb7668740296"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:31.594723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:31.603242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:31.603813 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:31.604780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:31.605170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:32.010109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:32.018833 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:32.020487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:32.021828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3f5c820e-a6e3-4825-bffd-aa95a119ce4d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1721 microversion: 2.20 time: 0.657269 Jun 23 09:29:32.022383 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 345/679] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:31 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1721 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:32.993811 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c5da920e-4e72-4220-91a5-9f0017d0db4c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.403631 Jun 23 09:29:32.993811 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 335/680] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:29:31 2022] POST /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments => generated 194 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:29:33.046019 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:33.046633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:33.052915 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:33.053433 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:33.054194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:33.054632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:33.191973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:33.200754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:33.202377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:33.216544 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-079ca26f-2adc-46d6-beb2-bc00659d31db tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1721 microversion: 2.20 time: 0.161515 Jun 23 09:29:33.230163 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 346/681] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:33 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:34.249109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:34.249109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:34.253214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:34.253855 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:34.254743 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:34.255324 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:34.361613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1704402911"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:34.362243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:34.369999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:34.379347 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:34.381006 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:34.381566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:34.449414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:34.457734 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:34.460320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:34.464362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b6e48752-81dc-43a2-9573-9cbf0e414077 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1721 microversion: 2.20 time: 0.230751 Jun 23 09:29:34.475426 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 336/682] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:34 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:34.617359 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.network.security_group_api [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Adding security group 657e3f01-8440-433b-9546-47422b69f308 to port 22e31120-c9ad-4071-b7c6-4a5042d14b7c Jun 23 09:29:35.153748 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-487522a6-c7a3-4e09-86ed-4e00b272a145 req-5461d352-abfd-4ae6-a107-d0085336304c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "name": "network-vif-unplugged", "status": "completed", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:35.164623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-487522a6-c7a3-4e09-86ed-4e00b272a145 req-5461d352-abfd-4ae6-a107-d0085336304c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.167553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-487522a6-c7a3-4e09-86ed-4e00b272a145 req-5461d352-abfd-4ae6-a107-d0085336304c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.180169 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-487522a6-c7a3-4e09-86ed-4e00b272a145 req-5461d352-abfd-4ae6-a107-d0085336304c service nova] Creating event network-vif-unplugged:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:29:35.185843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-487522a6-c7a3-4e09-86ed-4e00b272a145 req-5461d352-abfd-4ae6-a107-d0085336304c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037691 Jun 23 09:29:35.186525 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 337/683] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:35.192226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1590612699", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91dc23ae-594e-42cc-bac4-fbd112cab953"}], "security_groups": [{"name": "tempest-securitygroup--39956739"}], "key_name": "tempest-keypair-2111862993", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:35.315977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] validate_networks() for [('91dc23ae-594e-42cc-bac4-fbd112cab953', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:29:35.322132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-14b3f37f-4132-45a0-a217-d0d9e3c6059d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/action" status: 202 len: 0 microversion: 2.1 time: 0.964933 Jun 23 09:29:35.323768 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 347/684] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:29:34 2022] POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:29:35.331905 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:35.333015 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:35.346357 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.346878 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.347758 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.348186 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.560251 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:35.570409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4eef2c7c-524e-48b2-93b7-1286cfc09dee tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1761 microversion: 2.1 time: 0.242420 Jun 23 09:29:35.571354 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 348/685] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:35 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1761 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:35.683163 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-62ed9010-5af8-474b-905a-d8eb01c7ca2b req-0986b8b8-7fec-4ae4-8bde-cd4ba2603a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:35.700580 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-62ed9010-5af8-474b-905a-d8eb01c7ca2b req-0986b8b8-7fec-4ae4-8bde-cd4ba2603a4e service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.701316 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-62ed9010-5af8-474b-905a-d8eb01c7ca2b req-0986b8b8-7fec-4ae4-8bde-cd4ba2603a4e service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.732086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-62ed9010-5af8-474b-905a-d8eb01c7ca2b req-0986b8b8-7fec-4ae4-8bde-cd4ba2603a4e service nova] Creating event network-changed:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:29:35.737536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-62ed9010-5af8-474b-905a-d8eb01c7ca2b req-0986b8b8-7fec-4ae4-8bde-cd4ba2603a4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164043 Jun 23 09:29:35.741446 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 349/686] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:35.747413 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:35.749318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:35.756047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.756498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.757279 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.757717 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.861656 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:29:35.862677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:29:35.863480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:29:35.863990 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:29:35.864720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:29:35.875402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.876155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.877393 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:35.878021 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:35.898493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:29:35.902852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for user 9f0d4416e74a4126a6aa1ccf58e22ee3 and project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:29:35.914930 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:29:35.918691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:29:35.992603 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:36.010123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:36.011786 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:36.015041 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a8f0d2d0-b6b0-407a-a23c-ce5ffc26fad3 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1664 microversion: 2.20 time: 0.272198 Jun 23 09:29:36.028323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 350/687] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:35 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1664 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:36.035514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8623fcc-fa79-49b9-b748-963e93c18854"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:36.036960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:36.043487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:36.044169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:36.045131 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:36.045564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:36.193140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5eab8ccc-7b8c-40aa-8998-3c0adfb96622 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.005281 Jun 23 09:29:36.193923 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 338/688] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:29:35 2022] POST /compute/v2.1/servers => generated 400 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:29:36.207377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-64ed2078-0d51-4ce6-8710-0a0f8a9a4091 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:36.208319 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-64ed2078-0d51-4ce6-8710-0a0f8a9a4091 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:36.334833 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-64ed2078-0d51-4ce6-8710-0a0f8a9a4091 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:36.343216 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-64ed2078-0d51-4ce6-8710-0a0f8a9a4091 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1238 microversion: 2.1 time: 0.142554 Jun 23 09:29:36.344091 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 339/689] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:36 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1238 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:37.360224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cccfacc9-9caf-4253-9164-0f943d6da43c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:37.365011 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cccfacc9-9caf-4253-9164-0f943d6da43c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:37.413160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cccfacc9-9caf-4253-9164-0f943d6da43c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:37.420336 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cccfacc9-9caf-4253-9164-0f943d6da43c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1238 microversion: 2.1 time: 0.063934 Jun 23 09:29:37.420903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 340/690] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:37 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:37.548120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-268b5e15-f638-485d-9b4a-18e0e6e5ef0b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.516525 Jun 23 09:29:37.548743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 351/691] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Jun 23 09:29:36 2022] POST /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-volume_attachments => generated 188 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 09:29:37.663433 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:37.663930 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:37.671287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:37.671742 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:37.672508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:37.672944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:37.901280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:38.437445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:38.438165 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:38.445617 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:38.446066 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:38.446838 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:38.447309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:38.507706 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:38.515327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8f81cce1-48bd-43c5-85bb-25a670d47c5a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1242 microversion: 2.1 time: 0.081996 Jun 23 09:29:38.515884 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 352/692] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:38 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:38.576192 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-066e2410-b515-4361-9727-67492a719b3b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-volume_attachments/b8623fcc-fa79-49b9-b748-963e93c18854" status: 202 len: 0 microversion: 2.20 time: 0.916723 Jun 23 09:29:38.576817 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 341/693] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Jun 23 09:29:37 2022] DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-volume_attachments/b8623fcc-fa79-49b9-b748-963e93c18854 => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:29:38.633486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:38.634048 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:38.640508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:38.640946 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:38.641699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:38.642122 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:39.182749 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e7aeec6b-3af1-4d96-9cda-85e6f83c2e3d tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "POST /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/action" status: 202 len: 0 microversion: 2.20 time: 0.553086 Jun 23 09:29:39.183388 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 353/694] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jun 23 09:29:38 2022] POST /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:29:39.191580 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:39.192190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:39.194026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:39.199539 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:39.199985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:39.200750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:39.201186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:39.328764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:39.337282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:39.338956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:39.340119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a2fccfa0-dddc-4ffa-a0bf-c056998e29b0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1672 microversion: 2.20 time: 0.152456 Jun 23 09:29:39.340676 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 342/695] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:39 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:39.532473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:39.533107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:39.539253 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:39.539699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:39.540457 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:39.541414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:39.604220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:39.613259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c2f9d145-1870-4d95-8cdd-036362a5fbb3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1290 microversion: 2.1 time: 0.085231 Jun 23 09:29:39.613830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 354/696] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:39 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:40.358600 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:40.359270 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:40.366896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:40.367539 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:40.368191 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:40.368830 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:40.504089 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:40.512933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:40.514497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:40.515900 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e42441f4-2753-45fe-a1f4-28e187c36bf0 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1672 microversion: 2.20 time: 0.161822 Jun 23 09:29:40.516490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 343/697] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:40 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:40.635896 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:40.636788 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:40.647344 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=66 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:40.650002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:40.650669 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:40.651533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:40.652075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:40.804635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:40.812618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-13a3c257-9ac8-40f4-9217-378bd839c52e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.185031 Jun 23 09:29:40.813185 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 355/698] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:40 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:41.533569 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:41.534173 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:41.546496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:41.546962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:41.547738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:41.548170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:41.724364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:41.734877 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:41.737252 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:41.739372 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a4418c81-b7ed-40ac-adc2-08a23296a044 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1674 microversion: 2.20 time: 0.209416 Jun 23 09:29:41.740508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 344/699] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:41 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:41.830264 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:41.830871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:41.837633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:41.838286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:41.838779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:41.839738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:41.971419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-87d66434-912b-43eb-ad19-43e597dd1414 req-421503ca-d6bd-43e4-bb2a-d4280bec7029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ce77f-535c-48bb-b311-7c7c515b82df", "tag": "95dc3d13-1af1-41f6-949f-2220f4476942"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:41.990051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-87d66434-912b-43eb-ad19-43e597dd1414 req-421503ca-d6bd-43e4-bb2a-d4280bec7029 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:41.990497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-87d66434-912b-43eb-ad19-43e597dd1414 req-421503ca-d6bd-43e4-bb2a-d4280bec7029 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:42.004958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-87d66434-912b-43eb-ad19-43e597dd1414 req-421503ca-d6bd-43e4-bb2a-d4280bec7029 service nova] Creating event network-changed:95dc3d13-1af1-41f6-949f-2220f4476942 for instance 575ce77f-535c-48bb-b311-7c7c515b82df on hv-cinder-84727 Jun 23 09:29:42.010820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-87d66434-912b-43eb-ad19-43e597dd1414 req-421503ca-d6bd-43e4-bb2a-d4280bec7029 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043383 Jun 23 09:29:42.011546 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 345/700] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:29:42.049961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:42.058991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ca749bb5-8b09-4fc1-bcb9-46359df799a9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.232916 Jun 23 09:29:42.059770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 356/701] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:41 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:42.749083 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733bf5a3-701f-44e9-9b24-fb7668740296"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:42.750461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:42.758191 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:42.758674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:42.759037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:42.759301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:42.761046 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:42.761562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:42.766358 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:42.766903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:42.767815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:42.768495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:42.844664 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Invalid volume: volume 733bf5a3-701f-44e9-9b24-fb7668740296 is already attached to instances: 88e58a13-6ee6-4d01-840f-50a6cc456fb9 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: POST /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments HTTP/1.1 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 74 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:29:42.846519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {"volumeAttachment": {"volumeId": "733bf5a3-701f-44e9-9b24-fb7668740296"}} Jun 23 09:29:42.848233 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Invalid volume: volume 733bf5a3-701f-44e9-9b24-fb7668740296 is already attached to instances: 88e58a13-6ee6-4d01-840f-50a6cc456fb9 Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'server_id': '88e58a13-6ee6-4d01-840f-50a6cc456fb9', 'body': {'volumeAttachment': {'volumeId': '733bf5a3-701f-44e9-9b24-fb7668740296'}}} Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 733bf5a3-701f-44e9-9b24-fb7668740296 is already attached to instances: 88e58a13-6ee6-4d01-840f-50a6cc456fb9 Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:42.849130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 733bf5a3-701f-44e9-9b24-fb7668740296 is already attached to instances: 88e58a13-6ee6-4d01-840f-50a6cc456fb9 Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:29:42.850738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 733bf5a3-701f-44e9-9b24-fb7668740296 is already attached to instances: 88e58a13-6ee6-4d01-840f-50a6cc456fb9 Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 400 to user: Invalid volume: volume 733bf5a3-701f-44e9-9b24-fb7668740296 is already attached to instances: 88e58a13-6ee6-4d01-840f-50a6cc456fb9 {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-86b49ef4-4288-4297-8eac-5b88e0b3e354 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104393 Jun 23 09:29:42.853684 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 346/702] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:29:42 2022] POST /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:29:42.916202 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:42.916703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:42.922811 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:42.923294 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:42.924064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:42.924500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:43.005527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'services' on Instance uuid 88e58a13-6ee6-4d01-840f-50a6cc456fb9 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:29:43.092972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:43.101505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:43.103115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:43.104375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d43e43eb-5edd-417b-89b9-8a7657b5d8be tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.350689 Jun 23 09:29:43.105008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 357/703] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:42 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:43.109527 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:43.110203 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:43.116651 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:43.117090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:43.117911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:43.118352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:43.137381 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:43.347907 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d0f313e4-e83d-4c8f-9d2d-1d854f6525ca tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments/733bf5a3-701f-44e9-9b24-fb7668740296" status: 202 len: 0 microversion: 2.1 time: 0.435363 Jun 23 09:29:43.348720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 347/704] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:29:42 2022] DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments/733bf5a3-701f-44e9-9b24-fb7668740296 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:29:43.358225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:43.359418 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:43.366359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:43.366802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:43.367606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:43.368037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:43.398508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-92453942-8014-4bd1-a679-2de202abc8af tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Jun 23 09:29:43.399003 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 348/705] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:29:43 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:29:43.445871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:43.455418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c438923e-64da-4a4e-acb5-5749d21a39f8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.349047 Jun 23 09:29:43.456009 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 358/706] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:43 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:44.124425 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:44.125502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:44.131312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:44.131755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:44.132519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:44.132943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:44.274001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:44.282486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:44.284017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:44.285173 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9c8ce775-2783-4394-acda-c097183dbf7b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.166179 Jun 23 09:29:44.285721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 349/707] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:44 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:44.410696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:44.411802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:44.419447 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:44.419925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:44.420642 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:44.421069 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:44.449524 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a70e358b-4a9d-4222-bea9-e75207354efd tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042777 Jun 23 09:29:44.450078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 359/708] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:29:44 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:44.472437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:44.477993 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:44.479531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:44.479977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:44.480733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:44.481194 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:44.614869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:44.622221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-720183b2-cef9-4c0e-898b-5f7e72f021a0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.153646 Jun 23 09:29:44.622788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 350/709] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:44 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:45.303668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:45.304268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:45.311980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.312421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.313173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.313607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.461159 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:45.462308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:45.469568 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.470603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.471607 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.472933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.521097 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:45.523923 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cf5ce835-b5f8-43d1-a77e-04b04d2525f5 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066677 Jun 23 09:29:45.533279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 351/710] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:29:45 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:29:45.543878 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:45.548834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:45.550704 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-55df7e23-8105-4495-bc7f-50111a73cdbf tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.251024 Jun 23 09:29:45.555963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 360/711] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:45 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:45.617828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:45.618425 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:45.636339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.636906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.637889 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.638411 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.641986 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:45.642824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:45.650780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.651483 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.652248 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:45.652867 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:45.677047 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:29:45.821854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:45.830579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ab07b9bc-8d75-47a0-b2cf-57c4bc5b0e13 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.196237 Jun 23 09:29:45.831202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 361/712] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:45 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:45.890042 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:46.033875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-45d5dea5-7c6b-4cd5-aae0-cc7b53a1ea0a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 204 len: 0 microversion: 2.1 time: 0.420398 Jun 23 09:29:46.034634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 352/713] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:29:45 2022] DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:29:46.044871 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:46.045723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:46.053633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:46.054286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:46.055405 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:46.056018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:46.192406 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:46.200723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2dbcf0b2-aa7c-4f66-a333-d2e99a018c37 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.161607 Jun 23 09:29:46.201495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 362/714] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:46 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:46.575318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:46.576024 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:46.582763 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:46.583242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:46.584019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:46.584460 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:46.721814 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:46.730110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:46.731651 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:46.733044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-97aae6eb-3fc9-4379-8fa9-490d931d0fde tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.162610 Jun 23 09:29:46.733601 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 353/715] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:46 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:46.848110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:46.848737 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:46.855868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:46.856310 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:46.857072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:46.857504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.001173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:47.008947 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-43145ca5-70f4-4fae-9596-ba5204225b4a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.164654 Jun 23 09:29:47.009550 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 363/716] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:46 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:47.220791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:47.221429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:47.227956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.229009 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.229805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.230251 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.285593 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:47.286852 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:47.296302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.296932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.301943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.301943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.333759 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lazy-loading 'flavor' on Instance uuid 1c02a829-249f-434a-8551-deca0e564d14 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:29:47.400537 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:47.408627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fa0a6743-a312-47c5-bfcc-90399b1b401a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.194204 Jun 23 09:29:47.409390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 354/717] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:47 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:47.695546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fdd814c3-8979-405c-9985-55ce3292df71 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "POST /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14/action" status: 202 len: 0 microversion: 2.1 time: 0.415472 Jun 23 09:29:47.696142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 364/718] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:29:47 2022] POST /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:29:47.706131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:47.706748 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:47.709800 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=14 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:47.716211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.716669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.717446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.718062 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.734311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SELECT=92 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:47.753874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:47.754730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:47.765514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.768337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.769999 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:47.772002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:47.886391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:47.907390 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a7d5dffe-6b1e-45c5-90ea-4206da4a845e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.201114 Jun 23 09:29:47.915896 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 355/719] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:47 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:48.007436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:48.017233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:48.019119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:48.020752 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-efd62371-5dd8-4c3f-bf0a-fd8eb476625a tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.271739 Jun 23 09:29:48.021637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 365/720] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:47 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:48.026137 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:48.026749 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:48.033512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:48.033969 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:48.034731 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:48.035318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:48.200639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:48.217989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d1215adb-f3b3-4810-8afa-bc3a33c5a6ac tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.196246 Jun 23 09:29:48.218572 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 356/721] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:48 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:48.426796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:48.427451 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:48.433885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:48.434418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:48.435307 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:48.435817 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:48.570849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:48.583337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ac730d8b-125a-4cde-8fc0-e5a7bd0987c6 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.161306 Jun 23 09:29:48.584219 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 366/722] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:48 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:48.938478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:48.939148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:48.946059 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:48.946511 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:48.947937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:48.948377 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.039703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:49.040461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:49.047980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.048748 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.049755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.050392 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.122208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:49.131159 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1070fb2e-9d33-453c-a314-55c2a3540bfa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.197670 Jun 23 09:29:49.143549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 357/723] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:48 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:49.243241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:49.244810 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:49.256274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.256781 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.257576 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.258215 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.267830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:49.283193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:49.284898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:49.286246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3d7d8c33-4c8d-4cf0-b20a-8dfd8b2d986f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.250407 Jun 23 09:29:49.286978 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 367/724] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:49 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:49.448157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:49.456791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3933394b-e8b1-4ee0-aa24-be6480e8c3f3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.217510 Jun 23 09:29:49.458956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 358/725] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:49 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:49.529732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-86222ade-d6d9-4d63-9ce8-2a3edc625cd1 req-5cec2900-4cb8-4bf3-92f5-206d0c76107d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575ce77f-535c-48bb-b311-7c7c515b82df", "name": "network-vif-plugged", "status": "completed", "tag": "95dc3d13-1af1-41f6-949f-2220f4476942"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:49.537848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-86222ade-d6d9-4d63-9ce8-2a3edc625cd1 req-5cec2900-4cb8-4bf3-92f5-206d0c76107d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.538416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-86222ade-d6d9-4d63-9ce8-2a3edc625cd1 req-5cec2900-4cb8-4bf3-92f5-206d0c76107d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.551533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-86222ade-d6d9-4d63-9ce8-2a3edc625cd1 req-5cec2900-4cb8-4bf3-92f5-206d0c76107d service nova] Creating event network-vif-plugged:95dc3d13-1af1-41f6-949f-2220f4476942 for instance 575ce77f-535c-48bb-b311-7c7c515b82df on hv-cinder-84727 Jun 23 09:29:49.558601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-86222ade-d6d9-4d63-9ce8-2a3edc625cd1 req-5cec2900-4cb8-4bf3-92f5-206d0c76107d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123386 Jun 23 09:29:49.559503 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 368/726] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:29:49.600964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:49.601583 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:49.607822 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.608270 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.609039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.609475 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.724632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:49.725689 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:49.732263 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.732718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.733494 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:49.734134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:49.764841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:49.773084 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6df148db-4319-4adc-8fa9-e3b751de876c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.175911 Jun 23 09:29:49.783113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 359/727] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:49 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:49.975363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-676d4f43-a5cb-44eb-b2e1-1b739a01cac4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/action" status: 202 len: 0 microversion: 2.1 time: 0.254745 Jun 23 09:29:49.991709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 369/728] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:29:49 2022] POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:29:49.992066 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:49.992549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:50.000930 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.001392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.002157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.002587 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.161870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:50.162660 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:50.164116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.175134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.175601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.176376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.176814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.179924 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c8ce6c3c-0771-4c22-9a96-85cace52906e tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.191893 Jun 23 09:29:50.196707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 360/729] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:49 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:50.309178 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:50.309913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:50.316828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.317275 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.318038 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.318470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.327579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.336079 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cc732736-7975-4585-809e-f078fc2e4577 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.187655 Jun 23 09:29:50.346856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 370/730] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:50 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:50.474065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:50.475740 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:50.482064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.482653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.483546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.484062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.497686 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.506707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.508922 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.511091 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-570d1c6c-d792-4e4d-afcb-c143a6101b83 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.209118 Jun 23 09:29:50.522174 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 361/731] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:50 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:50.790362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:50.790949 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:50.797602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.798057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.798848 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:50.799446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:50.814210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.824808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-97355474-28e6-45e3-9607-4bd6c553b45e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.354501 Jun 23 09:29:50.836391 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 371/732] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:50 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:50.946481 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:50.954674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ce97b1a8-2b51-476d-b897-e4e34ae69941 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.168877 Jun 23 09:29:50.955311 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 362/733] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:50 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:51.204277 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:51.204921 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:51.211601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.212059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.212834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.213299 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.352870 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:51.354673 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:51.363944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:51.367679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:51.372295 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.372751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.373404 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0ad33f1a-7ee1-4ca2-a3e5-a8c6bec58858 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.172994 Jun 23 09:29:51.373529 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.373951 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.374388 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 372/734] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:51 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:51.523365 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:51.529854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:51.530683 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:51.531919 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6469c971-b74b-47aa-a70c-3be84ccdcf9b tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.183106 Jun 23 09:29:51.532806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 363/735] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:51 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:51.538065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.543244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.543244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.543244 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.687632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:51.696012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:51.698650 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:51.698816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-290ef6d7-32e7-4d0a-ae90-2cad234a6fe5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.174102 Jun 23 09:29:51.699328 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 373/736] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:51 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:51.843533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:51.844327 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:51.850667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.851268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.852150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.852679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.972312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:51.973083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:51.980713 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.981543 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:51.982423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:51.983832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.005193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.013579 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ebaced77-d735-45d0-8eb4-15e37db8c288 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.173842 Jun 23 09:29:52.014507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 364/737] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:51 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:52.129571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.138655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-726487de-500f-4a0d-a06c-d790ab9a14fb tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.170503 Jun 23 09:29:52.139599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 374/738] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:51 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:52.392429 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:52.393767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:52.400917 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:52.401371 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.402143 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:52.402598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.549585 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:52.550250 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:52.554530 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.557672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:52.558128 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.558944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:52.559533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.565804 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d45964d7-4841-4ae3-9432-781616ef5fe9 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.177149 Jun 23 09:29:52.577504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 365/739] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:52 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:52.703710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.712156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7fc91082-151e-4bd4-abb5-2221d7e08b9f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.166539 Jun 23 09:29:52.712710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 375/740] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:52 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:52.716323 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:52.716940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:52.723244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:52.723693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.724455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:52.724887 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:52.883940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.901954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.903468 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:52.904648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-369af4c5-5cfe-4efd-9c65-b50141bf40f4 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.192304 Jun 23 09:29:52.905199 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 366/741] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:52 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:53.031688 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:53.032298 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:53.038485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.038963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.039737 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.040175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.156868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:53.157312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:53.163678 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.164222 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.165108 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.165667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.182687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:53.200300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2dd712fc-e4f1-466f-adcb-23fc4bc5bb94 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.172626 Jun 23 09:29:53.203042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 376/742] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:53 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:53.302794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:53.311071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b2945e89-3fe2-45da-935e-0d8c5f6dbb08 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.158335 Jun 23 09:29:53.311650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 367/743] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:53 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:53.583841 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:53.584480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:53.591635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.592135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.592900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.593339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.729394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:53.730115 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:53.734365 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:53.736734 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.737182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.737951 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.738384 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.743120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6f9c0ca0-b0d9-4f40-a74e-5b45ef6d92f6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.163233 Jun 23 09:29:53.743694 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 377/744] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:53 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:53.868780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:53.876217 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cba2d6a6-bb90-4c4d-a758-a4f1bd7f012c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.150669 Jun 23 09:29:53.876780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 368/745] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:53 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:53.923276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:53.923883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:53.929969 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.930426 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:53.931211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:53.932189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.069802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:54.078783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:54.080327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:54.081477 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-98b63778-dfcb-4859-8945-8501849fc724 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.162088 Jun 23 09:29:54.082024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 378/746] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:53 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:54.219094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:54.219697 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:54.225724 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.226167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.226940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.227376 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.328016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:54.328618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:54.334688 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.335171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.335930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.336360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.360081 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:54.367837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0ef3a95e-7120-4e3d-b76a-aeeeca8e0740 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.152803 Jun 23 09:29:54.368565 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 369/747] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:54 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:54.464087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:54.471766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-bc6b636a-0ede-417b-a440-b4964b458d0c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.147542 Jun 23 09:29:54.472313 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 379/748] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:54 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:54.760183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:54.760771 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:54.767229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.767681 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.768441 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.768877 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.894459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:54.895101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:54.902049 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.903111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.903286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:54.903774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:54.913815 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:54.922733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bebf816a-c0bc-4818-a37b-f7e75030021a tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.166446 Jun 23 09:29:54.923344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 370/749] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:54 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:55.032760 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:55.040337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0c4d5598-e58a-4058-9ccc-696c8a6c859a tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.149816 Jun 23 09:29:55.041445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 380/750] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:54 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:55.099446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:55.100090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:55.106214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.106660 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.107453 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.107886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.237866 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:55.246793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:55.248331 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:55.249494 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f5f0eb30-acde-418d-9450-6a09599e6ced tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.153947 Jun 23 09:29:55.250058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 371/751] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:55 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:55.385633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:55.386242 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:55.404350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.404350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.404350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.404350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.489694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:55.490425 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:55.497000 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.497720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.498559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.499104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.503100 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=100 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:55.522123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:55.529603 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4fd476a7-612f-4485-bc95-a90f04466bc0 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.148256 Jun 23 09:29:55.530169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 381/752] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:55 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:55.624285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:55.631834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-176e2d18-cc23-4f08-957c-8011560a3407 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.146152 Jun 23 09:29:55.632865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 372/753] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:55 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:55.939892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:55.940413 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:55.946939 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.947398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:55.948152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:55.948588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.058020 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:56.058758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:56.065620 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.066070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.066834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.067344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.091428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.100304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0e6664cc-ed96-486a-a8ba-8f414948e148 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.164386 Jun 23 09:29:56.100874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 382/754] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:55 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:56.201031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.208487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a60b2161-86ea-46c9-8169-3ac987a919c2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.154911 Jun 23 09:29:56.209039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 373/755] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:56 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:56.268586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:56.269194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:56.276330 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.276789 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.277582 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.278065 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.444478 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.453246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.454160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.455351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ace162bb-2bce-4ece-b5f2-ecd3033c6fec tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.190939 Jun 23 09:29:56.455904 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 383/756] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:56 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:56.547063 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:56.547675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:56.557703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.558177 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.558967 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.559402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.649419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:56.650901 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:56.657156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.658415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.659730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:56.659730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:56.695689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.705239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-827eb246-f1de-4655-846c-07c25e9aabbe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.160872 Jun 23 09:29:56.705239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 374/757] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:56 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:56.971815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:56.979906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-55d77607-3f71-4983-a330-943a5cf16fbf tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1683 microversion: 2.1 time: 0.334408 Jun 23 09:29:56.980470 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 384/758] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:56 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1683 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:57.117903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:57.118516 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:57.125069 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.125517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.126283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.126716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.228874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:57.228874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:57.232942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.233395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.234364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.234808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.286119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:57.296205 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4acf0444-f680-4955-92ba-4b96c7ce3225 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.182199 Jun 23 09:29:57.299420 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 375/759] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:57 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:57.473740 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:57.474537 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:57.480925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.481395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.482253 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.482890 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.620480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:57.628863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:57.630707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:57.632240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-46b8fa9d-1b7b-466f-93fc-10f3cad4daea tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.162530 Jun 23 09:29:57.636986 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 376/760] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:57 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:29:57.721373 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:57.721982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:57.728208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.728709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.729595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.730040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.733761 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:57.742042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1e4dfdb9-93ac-48ee-8c73-718808889b94 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.520116 Jun 23 09:29:57.742687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 385/761] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:57 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:57.876437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:57.890172 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3b78ba06-4a04-408c-982d-c2bed14aa944 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1362 microversion: 2.1 time: 0.172358 Jun 23 09:29:57.891414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 377/762] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:57 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:57.916393 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-17290f5b-6265-4c41-b4f3-bb2a6321da60 req-2f3ada8c-b2aa-4975-a778-eb5b21d5f5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e58a13-6ee6-4d01-840f-50a6cc456fb9", "name": "network-vif-deleted", "tag": "63dcea29-ad70-42db-bd2d-65baa87be113"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:57.925019 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-17290f5b-6265-4c41-b4f3-bb2a6321da60 req-2f3ada8c-b2aa-4975-a778-eb5b21d5f5e2 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:57.925548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-17290f5b-6265-4c41-b4f3-bb2a6321da60 req-2f3ada8c-b2aa-4975-a778-eb5b21d5f5e2 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:57.948946 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-17290f5b-6265-4c41-b4f3-bb2a6321da60 req-2f3ada8c-b2aa-4975-a778-eb5b21d5f5e2 service nova] Creating event network-vif-deleted:63dcea29-ad70-42db-bd2d-65baa87be113 for instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 on hv-cinder-84727 Jun 23 09:29:57.956836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-17290f5b-6265-4c41-b4f3-bb2a6321da60 req-2f3ada8c-b2aa-4975-a778-eb5b21d5f5e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044522 Jun 23 09:29:57.957682 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 386/763] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:57.998931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:57.999558 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:58.006258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.006704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.007654 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.015663 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.091490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:58.100150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6726b3ae-b638-43f2-8698-cbef2fbd6612 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1615 microversion: 2.1 time: 0.106312 Jun 23 09:29:58.108567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 378/764] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:57 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:58.317997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:58.319708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:58.336744 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.338082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.339521 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.340223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.527510 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:58.535984 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5f6e69e1-e1b0-4593-8bf0-7ab5b86fc730 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1753 microversion: 2.1 time: 0.223449 Jun 23 09:29:58.536556 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 387/765] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:58 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:58.656113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:58.656979 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:58.664030 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.664473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.665299 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.666293 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.758551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:58.759539 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:58.765982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.766443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.767361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.767806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.802842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:58.811444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:58.812969 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:58.814155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2734ce64-3066-412a-adab-36a810b16dfd tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.162125 Jun 23 09:29:58.815001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 379/766] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:58 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:29:58.907406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:58.908583 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:58.918009 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.918484 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.919297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:58.919739 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:58.927186 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:58.937942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f8f1ee80-7cd2-41a0-8ff9-414701866d32 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.183152 Jun 23 09:29:58.938716 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 388/767] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:58 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:59.066144 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:59.074417 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ef0bcc94-cf0e-41d5-9e87-37de13474349 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1547 microversion: 2.1 time: 0.170824 Jun 23 09:29:59.075023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 380/768] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:58 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:29:59.090792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:59.091318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:59.097352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.097802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.098560 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.099018 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.118107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:59.119293 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:59.125706 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.126158 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.127013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.127611 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.163988 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.164447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.164892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'fault' on Instance uuid 88e58a13-6ee6-4d01-840f-50a6cc456fb9 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:29:59.193343 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9877d3c7-6fc2-43bd-99f2-89895f194078 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106406 Jun 23 09:29:59.194105 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 389/769] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:29:59 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:29:59.206284 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:59.214486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d04fb75b-f0e3-4e83-bb78-af4ebda3a567 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 200 len: 1332 microversion: 2.1 time: 0.100014 Jun 23 09:29:59.219091 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 381/770] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:59 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:59.408911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-9fe3d62b-1c2c-4cee-bfcc-161456488dc5 req-e530b367-7234-4e64-a0f9-9c9d0fec5a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "name": "network-vif-plugged", "status": "completed", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:29:59.419318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-9fe3d62b-1c2c-4cee-bfcc-161456488dc5 req-e530b367-7234-4e64-a0f9-9c9d0fec5a63 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.419783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-9fe3d62b-1c2c-4cee-bfcc-161456488dc5 req-e530b367-7234-4e64-a0f9-9c9d0fec5a63 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.431792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-9fe3d62b-1c2c-4cee-bfcc-161456488dc5 req-e530b367-7234-4e64-a0f9-9c9d0fec5a63 service nova] Creating event network-vif-plugged:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:29:59.437328 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-9fe3d62b-1c2c-4cee-bfcc-161456488dc5 req-e530b367-7234-4e64-a0f9-9c9d0fec5a63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033274 Jun 23 09:29:59.437909 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 390/771] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:29:59.553741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:59.554630 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:59.561503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.562172 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.563145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.563741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.721354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:29:59.729989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b6ea60fd-3c7d-4505-9640-bc84ed69d078 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.180174 Jun 23 09:29:59.730558 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 382/772] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:59 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:29:59.833613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:59.834222 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:59.841414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.843991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.843991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.843991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.847796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:59.955743 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:29:59.956363 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:29:59.962898 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.963449 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:29:59.964223 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:29:59.964662 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:00.110725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:00.118976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d3acc36a-fde9-4147-a1e0-821e63fef3b5 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.166921 Jun 23 09:30:00.119381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 383/773] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:29:59 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:00.137461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:00.145454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:00.146994 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:00.148161 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7d1f1dac-7f0e-418e-9136-8fc184ab385f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.319046 Jun 23 09:30:00.148731 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 391/774] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:29:59 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:30:00.233636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:00.234340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:00.240580 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:00.241022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:00.241776 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:00.242209 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:00.256202 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 HTTP/1.1 Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:30:00.257885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:30:00.260149 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '88e58a13-6ee6-4d01-840f-50a6cc456fb9'} Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:30:00.261065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:30:00.262746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:00.264082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:30:00.264082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-729d51ac-f0bb-432b-8315-7f5e55bd881e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 404 len: 111 microversion: 2.1 time: 0.029599 Jun 23 09:30:00.264082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 384/775] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:00 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:30:00.269869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9a3e2b56-fd2f-430f-a3da-0538630ea284 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '.version_select at 0x7f827513ddc0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:00.394622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9a3e2b56-fd2f-430f-a3da-0538630ea284 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230979419" status: 202 len: 0 microversion: 2.1 time: 0.128404 Jun 23 09:30:00.396257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 392/776] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:30:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230979419 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:30:00.462251 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-5765a314-c71d-4356-a5c5-26a04ff146b7 req-e67f2357-6cb4-40a1-9c4e-b58a7c59ed79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ce77f-535c-48bb-b311-7c7c515b82df", "tag": "95dc3d13-1af1-41f6-949f-2220f4476942"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:00.471282 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-5765a314-c71d-4356-a5c5-26a04ff146b7 req-e67f2357-6cb4-40a1-9c4e-b58a7c59ed79 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:00.471674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-5765a314-c71d-4356-a5c5-26a04ff146b7 req-e67f2357-6cb4-40a1-9c4e-b58a7c59ed79 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:00.483825 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-5765a314-c71d-4356-a5c5-26a04ff146b7 req-e67f2357-6cb4-40a1-9c4e-b58a7c59ed79 service nova] Creating event network-changed:95dc3d13-1af1-41f6-949f-2220f4476942 for instance 575ce77f-535c-48bb-b311-7c7c515b82df on hv-cinder-84727 Jun 23 09:30:00.490030 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-5765a314-c71d-4356-a5c5-26a04ff146b7 req-e67f2357-6cb4-40a1-9c4e-b58a7c59ed79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Jun 23 09:30:00.492123 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 385/777] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:00.749178 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:00.750565 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:00.763550 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:00.766247 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:00.767351 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:00.768021 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:00.989109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:00.998710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-366d5d40-579a-41c3-8447-242cc73ce7d4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.253852 Jun 23 09:30:00.999945 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 393/778] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:00 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:01.137056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:01.139065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:01.146674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:01.147502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:01.148502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:01.149163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:01.167638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:01.167638 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:01.176149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:01.176599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:01.177374 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:01.177807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:01.335709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:01.341495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:01.349944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:01.350811 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-622b310d-182b-433a-b121-48b48b9e0f2c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.218508 Jun 23 09:30:01.376842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 386/779] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:01 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:01.377533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:01.377533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-032e8950-49d8-4c8d-8552-ba8f4a3b280e tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.190664 Jun 23 09:30:01.377841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-faa7c9cb-44bf-46d7-9ddd-149936d7a6d1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: .version_select at 0x7f8270997c10>, body: {"keypair": {"name": "tempest-keypair-1669381738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDT10RwXTtz/y8Ac5eb9oyCz34Ekk1Lc445i/tK2Ssi0RgiYsvsLB0ZOlVfxZ0xrfwYcv2qhLt8DLIJqh8pGhsd0fKZZaDCuak14SegJaOaBteS1JI80gRYOnhWnpDuz1Q=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:01.377965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 394/780] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:01 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:30:01.378148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:01.378148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-faa7c9cb-44bf-46d7-9ddd-149936d7a6d1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:30:01.378148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-faa7c9cb-44bf-46d7-9ddd-149936d7a6d1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:30:01.492196 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-faa7c9cb-44bf-46d7-9ddd-149936d7a6d1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139722 Jun 23 09:30:01.492801 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 387/781] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:30:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:02.015459 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:02.016081 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:02.022875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:02.023149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:02.023925 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:02.025862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:02.183206 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:02.191475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-421501b8-9d96-44e2-b666-6078f2c9273f tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.179865 Jun 23 09:30:02.192037 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 395/782] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:02 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:02.368729 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:02.369354 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:02.372666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:02.373409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:02.375525 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:02.375982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:02.381361 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:02.381361 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:02.381637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:02.381637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:02.381637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:02.381637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:02.531349 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:02.539445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:02.541806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:02.545026 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b420aaa7-3398-4bd0-ab31-f3ef77ab4fd1 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1730 microversion: 2.20 time: 0.175216 Jun 23 09:30:02.545026 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 396/783] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:02 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:30:02.559268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:02.568631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-079ee7ff-fa4d-4f74-b3d1-b1bfdf4560b1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.204419 Jun 23 09:30:02.574383 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 388/784] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:02 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:03.208809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:03.209542 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:03.216127 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:03.216583 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:03.217363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:03.217855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:03.367319 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:03.375976 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b30f793a-08f7-4916-8f84-5dc74b755125 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.170835 Jun 23 09:30:03.376259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 397/785] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:03 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:03.561746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:03.562440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:03.569357 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:03.569987 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:03.570978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:03.571490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:03.591311 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:03.592149 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:03.599268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:03.599951 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:03.600895 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:03.601330 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:03.716724 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:03.724920 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:03.726434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:03.727668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-eb19392f-b684-4436-818c-7fcbf8d5bae2 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1717 microversion: 2.20 time: 0.170168 Jun 23 09:30:03.728840 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 389/786] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:03 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:30:03.739938 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:03.747568 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5e7d1efe-1efc-483a-9a2b-8019678c9e83 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.161655 Jun 23 09:30:03.748135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 398/787] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:03 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:04.312774 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1535819167", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "308c25e5-5cce-431f-b4d9-9d80a125cd28"}], "security_groups": [{"name": "tempest-securitygroup--1934935705"}], "key_name": "tempest-keypair-1669381738", "user_data": "}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:04.392933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:04.393692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:04.401238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:04.401765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:04.402593 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:04.403064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:04.416152 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] validate_networks() for [('308c25e5-5cce-431f-b4d9-9d80a125cd28', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:30:04.544827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:04.552931 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-aba47fde-030b-446f-bb1e-f9debdd4bb77 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.163816 Jun 23 09:30:04.553414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 399/788] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:04 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:04.765160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:04.765802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:04.771722 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:04.772182 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:04.772921 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:04.773352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:04.794885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:30:04.795416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:30:04.795802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:30:04.796280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:30:04.796698 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:30:04.805740 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:04.806646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:04.807491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:04.807936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:04.826018 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:30:04.830169 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Getting quotas for user ad5452341ccc40bc94b38369dae4f2b8 and project 8d0795f7c61d497c9b25c7e17ad08744. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:30:04.841683 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:30:04.844104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:30:04.912291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:04.919794 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5d511214-b374-4a3b-827c-a58680161536 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.158607 Jun 23 09:30:04.920352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 400/789] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:04 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:04.967729 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-cbab9281-3c13-4db4-a8af-91716abe33e1 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659194 Jun 23 09:30:04.968421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 390/790] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:30:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:30:04.983150 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a6ef1e94-548b-431d-9a33-c593dba5cd14 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:04.983827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a6ef1e94-548b-431d-9a33-c593dba5cd14 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:05.037583 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a6ef1e94-548b-431d-9a33-c593dba5cd14 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:05.044156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a6ef1e94-548b-431d-9a33-c593dba5cd14 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1242 microversion: 2.1 time: 0.065848 Jun 23 09:30:05.044715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 401/791] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:04 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:05.625566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:05.626179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:05.633327 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:05.633776 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:05.634535 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:05.634998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:05.649485 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=100 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:05.776244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:05.784560 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a0b5b576-548b-4fbe-9363-53f1f42631ed tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.162990 Jun 23 09:30:05.785209 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 391/792] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:05 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:05.937356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:05.937912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:05.944445 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:05.944899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:05.945665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:05.946103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:06.061358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:06.065232 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:06.068873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:06.069634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:06.070094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:06.070543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:06.090356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:06.098252 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-41499a9c-73c5-493e-a179-51b5abbf3a4e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.164846 Jun 23 09:30:06.098830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 402/793] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:05 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:06.137013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:06.144559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-33281a7d-7de6-4e01-9052-d47851e081f3 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1246 microversion: 2.1 time: 0.087245 Jun 23 09:30:06.145124 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 392/794] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:06 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:06.801596 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:06.802213 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:06.804163 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:06.809419 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:06.809872 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:06.810630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:06.811106 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:07.048279 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:07.056769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2b00a3ba-9182-4989-8945-cafd98e4a812 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.258529 Jun 23 09:30:07.057337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 403/795] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:06 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:07.116604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:07.117864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:07.124935 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:07.125956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:07.126739 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:07.127693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:07.162128 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:07.162868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:07.173677 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:07.174162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:07.175754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:07.176195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:07.253480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:07.262794 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c019eb6b-5f20-4a76-a6ea-8c832d53f96e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1302 microversion: 2.1 time: 0.104690 Jun 23 09:30:07.263606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 404/796] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:07 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:07.276522 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:07.284633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d302652d-232c-4eba-aadc-745b6a33a857 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.172394 Jun 23 09:30:07.285207 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 393/797] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:07 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:08.073749 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:08.074334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:08.088536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:08.089093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:08.089977 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:08.090505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:08.234607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:08.242888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d4e659fa-5278-48a6-9515-f04d70a2e71d tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.173019 Jun 23 09:30:08.243465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 405/798] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:08 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:08.280005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:08.280627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:08.287168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:08.287616 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:08.288421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:08.288864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:08.302513 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:08.303189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:08.309069 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:08.309609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:08.310289 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:08.310738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:08.349975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:08.358398 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-632981af-af40-459f-ba24-4a81846e4694 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1302 microversion: 2.1 time: 0.082311 Jun 23 09:30:08.359188 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 394/799] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:08 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:08.439571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:08.447142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7b3ffe5f-6690-4483-94cf-1aebeae1b050 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.148473 Jun 23 09:30:08.447764 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 406/800] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:08 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:09.260378 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:09.261099 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:09.267204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:09.267669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:09.268440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:09.268875 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:09.376135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:09.377505 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:09.385470 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:09.386278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:09.387430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:09.388136 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:09.435754 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:09.444053 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5d6fb89a-95fc-4372-bca6-c85e71a4cca5 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.188074 Jun 23 09:30:09.444865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 395/801] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:09 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:09.464832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:09.468664 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:09.472255 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:09.472717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:09.473495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:09.473936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:09.476647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:09.485211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-64cbc455-c81d-4e53-a6db-0e51e8e2553e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1300 microversion: 2.1 time: 0.113235 Jun 23 09:30:09.485789 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 407/802] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:09 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:09.615539 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:09.628997 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-db9db792-701a-4bad-ba5e-1daa1eb1b278 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.168872 Jun 23 09:30:09.629705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 396/803] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:09 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:10.461727 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:10.462977 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:10.469453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.469905 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.470677 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.471152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.503595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:10.504583 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:10.511646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.512161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.513103 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.513536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.623555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:10.631972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7e476740-9cd1-4488-9dc9-834837aa5fdd tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.174260 Jun 23 09:30:10.632545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 408/804] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:10 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:10.649691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:10.650439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:10.650928 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:10.656941 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.657516 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.658447 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.659185 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.682843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b0f2b0d2-8190-46d6-a4ca-059af3a5039f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.180547 Jun 23 09:30:10.693005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 397/805] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:10 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:10.875092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:10.879173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:10.884877 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-63a6fc74-9ba2-478d-88cc-e0ecbe1341ad tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1507 microversion: 2.1 time: 0.239546 Jun 23 09:30:10.885467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 409/806] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:10 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:10.902162 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:10.902886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:10.909242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.909691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:10.910461 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:10.910897 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.096832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-457192f5-4926-4058-b938-a9d072fd29ef req-e9106be0-93bc-4673-a79c-7f296056e478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07552f3-8f05-43be-9c71-115133c1efbf", "tag": "c9d1a564-114e-4aa5-8d8c-8f2812e40962"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:11.105512 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-457192f5-4926-4058-b938-a9d072fd29ef req-e9106be0-93bc-4673-a79c-7f296056e478 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.106588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-457192f5-4926-4058-b938-a9d072fd29ef req-e9106be0-93bc-4673-a79c-7f296056e478 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.119360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-457192f5-4926-4058-b938-a9d072fd29ef req-e9106be0-93bc-4673-a79c-7f296056e478 service nova] Creating event network-changed:c9d1a564-114e-4aa5-8d8c-8f2812e40962 for instance a07552f3-8f05-43be-9c71-115133c1efbf on hv-cinder-84727 Jun 23 09:30:11.124538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-457192f5-4926-4058-b938-a9d072fd29ef req-e9106be0-93bc-4673-a79c-7f296056e478 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031393 Jun 23 09:30:11.125129 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 410/807] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:30:11.155980 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6c8209c0-0d63-48af-9f6c-bbb7ee8723ce tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "POST /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14/action" status: 202 len: 0 microversion: 2.1 time: 0.258415 Jun 23 09:30:11.157438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 398/808] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:30:10 2022] POST /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:30:11.166097 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:11.166802 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:11.173465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.173922 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.174695 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.175163 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.388737 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:11.398285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d7040ead-a920-49f0-97f2-e9165cda08fc tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1515 microversion: 2.1 time: 0.236367 Jun 23 09:30:11.398865 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 411/809] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:11 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:11.650254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:11.651037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:11.659777 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.660240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.661044 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.661543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.699124 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:11.699735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:11.709177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.710764 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.710764 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:11.710992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:11.812668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:11.821100 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-21490af3-bf3d-4718-89ec-dc0172fa5772 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.175392 Jun 23 09:30:11.821677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 399/810] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:11 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:11.917828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:11.925422 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-733abc52-c758-45d7-b36b-e4177d5bae5f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.230261 Jun 23 09:30:11.925985 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 412/811] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:11 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:12.416010 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:12.416542 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:12.422636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:12.423142 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:12.423945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:12.424353 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:12.552702 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:12.560299 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-85346875-9de6-40f6-b473-f99955e5e0f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1515 microversion: 2.1 time: 0.148350 Jun 23 09:30:12.560869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 400/812] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:12 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:12.837530 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:12.838151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:12.844738 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:12.845188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:12.845957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:12.846396 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:12.942860 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:12.943506 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:12.950604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:12.951094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:12.951864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:12.952305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:12.990151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:12.998832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-87e0eb19-83e3-4572-a645-0808aec28b99 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.165165 Jun 23 09:30:12.999437 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 413/813] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:12 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:13.084306 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:13.092156 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c399e151-4da1-400a-b020-8a3c6633bb8a tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.153059 Jun 23 09:30:13.092730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 401/814] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:12 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:13.336352 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-02c98562-8379-49d1-9a40-331dce415fe4 req-b92816cb-9052-4f21-85fc-40074ac393a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "name": "network-vif-unplugged", "status": "completed", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:13.344456 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-02c98562-8379-49d1-9a40-331dce415fe4 req-b92816cb-9052-4f21-85fc-40074ac393a6 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:13.344906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-02c98562-8379-49d1-9a40-331dce415fe4 req-b92816cb-9052-4f21-85fc-40074ac393a6 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:13.356339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.compute.server_external_events [req-02c98562-8379-49d1-9a40-331dce415fe4 req-b92816cb-9052-4f21-85fc-40074ac393a6 service nova] Unable to find a host for instance 1c02a829-249f-434a-8551-deca0e564d14. Dropping event network-vif-unplugged {{(pid=118500) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 09:30:13.357224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-02c98562-8379-49d1-9a40-331dce415fe4 req-b92816cb-9052-4f21-85fc-40074ac393a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024820 Jun 23 09:30:13.357773 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 414/815] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 09:30:13.577500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:13.578109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:13.584164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:13.584603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:13.585350 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:13.585780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:13.717779 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:13.725486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c22e8c47-ea7f-4c61-b89d-26674f3702c8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1517 microversion: 2.1 time: 0.151823 Jun 23 09:30:13.726094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 402/816] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:13 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:14.016098 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:14.016835 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:14.023386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:14.023844 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:14.024594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:14.025656 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:14.109036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:14.109648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:14.116363 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:14.116816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:14.117578 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:14.118014 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:14.183855 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:14.194271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f71959c3-d0e9-4163-9c07-4add2cea7256 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.181198 Jun 23 09:30:14.194271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 415/817] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:14 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:14.286226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:14.295115 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5de52eaf-2004-4de3-8142-46025bf0f39e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.189818 Jun 23 09:30:14.304536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 403/818] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:14 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:14.748951 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:14.749566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:14.755862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:14.756319 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:14.757090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:14.757574 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:14.891584 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:14.899101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8ef5a571-7fa7-465c-a769-d1fe941673a9 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.154696 Jun 23 09:30:14.901007 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 416/819] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:14 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:15.211809 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:15.212471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:15.214297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:15.215016 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=10 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:15.220422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:15.220861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:15.221689 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:15.222122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:15.311648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:15.313010 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:15.316767 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:15.321010 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:15.321670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:15.323167 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:15.323697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:15.375693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:15.383938 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-58cd5700-8ffa-492d-8039-5741e2505fea tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1758 microversion: 2.1 time: 0.175869 Jun 23 09:30:15.384764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 404/820] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:15 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:15.483507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:15.491566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f3eeb06d-6619-46dc-9225-e90803b8eb45 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.183887 Jun 23 09:30:15.492183 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 417/821] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:15 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:15.917057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:15.917696 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:15.923749 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:15.924204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:15.924974 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:15.925408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:16.066090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:16.074883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8a3b3e7a-2b8f-4317-a0cd-4936fce3101d tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.161780 Jun 23 09:30:16.085091 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 405/822] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:15 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:16.401348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:16.401965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:16.408515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:16.408962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:16.409724 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:16.410173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:16.509874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:16.510408 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:16.516886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:16.517337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:16.518112 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:16.518610 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:16.556156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:16.564294 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-42feba6e-0ae2-41db-b23f-93fd2af31999 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1761 microversion: 2.1 time: 0.166877 Jun 23 09:30:16.564876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 418/823] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:16 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:16.650394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:16.658001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d07e14a1-e500-47bf-a9b6-7dcc67a23ddc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.152147 Jun 23 09:30:16.658570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 406/824] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:16 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:17.092723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:17.093363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:17.099620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:17.100070 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:17.100833 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:17.101270 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:17.228545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:17.236082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d7dbf7f2-7a7f-4cbd-85ea-ad738331c00e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.147273 Jun 23 09:30:17.236914 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 419/825] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:17 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:17.498728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-f9960620-7001-4fc8-ac7f-b75ff2127d6f req-b16b5f22-c36f-4d0d-b5db-bf402faddad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07552f3-8f05-43be-9c71-115133c1efbf", "name": "network-vif-plugged", "status": "completed", "tag": "c9d1a564-114e-4aa5-8d8c-8f2812e40962"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:17.506851 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-f9960620-7001-4fc8-ac7f-b75ff2127d6f req-b16b5f22-c36f-4d0d-b5db-bf402faddad4 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:17.507321 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-f9960620-7001-4fc8-ac7f-b75ff2127d6f req-b16b5f22-c36f-4d0d-b5db-bf402faddad4 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:17.511489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:17.518892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-f9960620-7001-4fc8-ac7f-b75ff2127d6f req-b16b5f22-c36f-4d0d-b5db-bf402faddad4 service nova] Creating event network-vif-plugged:c9d1a564-114e-4aa5-8d8c-8f2812e40962 for instance a07552f3-8f05-43be-9c71-115133c1efbf on hv-cinder-84727 Jun 23 09:30:17.523872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-f9960620-7001-4fc8-ac7f-b75ff2127d6f req-b16b5f22-c36f-4d0d-b5db-bf402faddad4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028898 Jun 23 09:30:17.524435 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 407/826] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:17.675516 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:17.683681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:17.683681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:17.683681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:17.684428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:17.684858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:17.814211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:17.821784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7bbbf370-42bc-4526-8aad-c7ac42ddec21 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.150213 Jun 23 09:30:17.822343 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 420/827] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:17 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:18.254834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:18.255469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:18.261939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:18.262380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:18.263157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:18.263588 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:18.392751 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:18.400873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fbeff0c1-28cb-4680-86f7-201f1ac52dc1 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.150840 Jun 23 09:30:18.401513 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 408/828] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:18 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:18.838725 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:18.839369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:18.845875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:18.846323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:18.847124 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:18.847566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:18.973821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:18.981210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b5ded332-8afd-4802-8214-34229a5ace8f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1368 microversion: 2.1 time: 0.146397 Jun 23 09:30:18.981767 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 421/829] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:18 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:19.417414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:19.418036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:19.424473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:19.424920 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:19.425679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:19.426114 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:19.558005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:19.565536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6b8e526f-3361-4a57-a60d-5c5ff46e697f tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.152151 Jun 23 09:30:19.566097 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 409/830] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:19 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:19.998414 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:19.999106 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:20.005730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:20.006182 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:20.006976 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:20.007427 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:20.387157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:20.394825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e76a2589-c076-492a-af99-e009f8065668 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1558 microversion: 2.1 time: 0.401041 Jun 23 09:30:20.396080 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 422/831] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:19 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1558 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:20.414219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:20.414714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:20.420976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:20.421608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:20.422190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:20.422627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:20.504888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f76d32b6-556d-4302-ad9a-a96643c3ec96 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094486 Jun 23 09:30:20.505493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 410/832] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:30:20 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:20.583554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:20.584102 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:20.591700 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:20.592237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:20.593025 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:20.593475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:20.725494 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:20.734134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-74dc9613-2752-482a-8797-cb439b120bd6 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.154609 Jun 23 09:30:20.747732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 423/833] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:20 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:21.482729 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-4880e4a7-15a3-4a85-8eba-a0add282967b req-3f4f0120-dfbf-4a8e-a701-e0158db38a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07552f3-8f05-43be-9c71-115133c1efbf", "tag": "c9d1a564-114e-4aa5-8d8c-8f2812e40962"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:21.492170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-4880e4a7-15a3-4a85-8eba-a0add282967b req-3f4f0120-dfbf-4a8e-a701-e0158db38a95 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:21.492725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-4880e4a7-15a3-4a85-8eba-a0add282967b req-3f4f0120-dfbf-4a8e-a701-e0158db38a95 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:21.504791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-4880e4a7-15a3-4a85-8eba-a0add282967b req-3f4f0120-dfbf-4a8e-a701-e0158db38a95 service nova] Creating event network-changed:c9d1a564-114e-4aa5-8d8c-8f2812e40962 for instance a07552f3-8f05-43be-9c71-115133c1efbf on hv-cinder-84727 Jun 23 09:30:21.509564 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-4880e4a7-15a3-4a85-8eba-a0add282967b req-3f4f0120-dfbf-4a8e-a701-e0158db38a95 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031628 Jun 23 09:30:21.510155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 411/834] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:21.752036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:21.752843 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:21.759789 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:21.765209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:21.765209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:21.765209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:21.922364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:21.930905 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d278499a-c351-4f38-93c4-76f948365fa8 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.182830 Jun 23 09:30:21.933056 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 424/835] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:21 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:22.950160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:22.950794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:22.957093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:22.959688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:22.959688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:22.959688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:23.090105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:23.097835 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a6032365-1d94-4efa-8384-dbdc36dfe201 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.152904 Jun 23 09:30:23.098405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 412/836] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:22 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:24.115089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:24.115723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:24.122712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:24.123222 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:24.124003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:24.124435 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:24.254755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:24.262889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9d9f4775-9b9a-4508-98d3-e051685023ab tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.151968 Jun 23 09:30:24.263498 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 425/837] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:24 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:25.280057 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:25.280700 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:25.287406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:25.287872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:25.288819 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:25.289258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:25.436392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:25.444942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-62a0bdef-d2a6-4326-bc30-c6f31e0baace tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.168756 Jun 23 09:30:25.451645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 413/838] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:25 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:26.462156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:26.463327 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:26.470108 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:26.470668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:26.471474 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:26.471914 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:26.608907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:26.616755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a8657c85-73e6-4db3-a674-431b35df6afe tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.158540 Jun 23 09:30:26.617315 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 426/839] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:26 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:27.472384 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-b6ddd50d-02be-4c73-bc93-12822f95d5a6 req-716065fb-9042-4168-8bfa-af265bc0bcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "name": "network-vif-plugged", "status": "completed", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:27.481052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-b6ddd50d-02be-4c73-bc93-12822f95d5a6 req-716065fb-9042-4168-8bfa-af265bc0bcfe service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:27.481477 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-b6ddd50d-02be-4c73-bc93-12822f95d5a6 req-716065fb-9042-4168-8bfa-af265bc0bcfe service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:27.492335 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-b6ddd50d-02be-4c73-bc93-12822f95d5a6 req-716065fb-9042-4168-8bfa-af265bc0bcfe service nova] Creating event network-vif-plugged:866d3ed7-aceb-4e8d-a61f-b4881b214198 for instance 1c02a829-249f-434a-8551-deca0e564d14 on hv-cinder-84727 Jun 23 09:30:27.498264 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-b6ddd50d-02be-4c73-bc93-12822f95d5a6 req-716065fb-9042-4168-8bfa-af265bc0bcfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029613 Jun 23 09:30:27.498849 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 414/840] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:27.633678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:27.634807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:27.641347 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:27.641790 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:27.642540 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:27.643122 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:27.774547 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:27.778685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=100 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:27.783077 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4b43ff5f-5879-43ff-9c07-bfa1b5ed3296 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.153368 Jun 23 09:30:27.783649 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 427/841] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:27 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:28.800785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:28.801484 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:28.808672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:28.809128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:28.809886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:28.810321 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:28.941728 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:28.949259 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1fe3fcdd-7a49-4407-a4fa-577573beaa45 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1573 microversion: 2.1 time: 0.152642 Jun 23 09:30:28.949826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 415/842] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:28 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:29.966859 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:29.967549 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:29.974221 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:29.974782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:29.975577 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:29.976114 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:30.107614 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:30.115526 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7b16976f-9b6b-4565-8f5e-350e845fd4ff tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1560 microversion: 2.1 time: 0.153222 Jun 23 09:30:30.116084 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 428/843] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:29 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:42.541249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:42.542229 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:42.544953 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:42.545643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=39 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:42.550419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:42.550938 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:42.551706 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:42.552144 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:42.582166 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-76eb1a8f-3fdc-4d54-8db5-f0cbd11341e5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045033 Jun 23 09:30:42.582746 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 416/844] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jun 23 09:30:42 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:42.643099 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:42.649545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:42.649545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=51 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:42.649545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:30:42.654463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:42.654940 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:42.655752 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:42.656210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:42.682592 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:30:43.210062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-746d3e0c-d2f6-4272-9346-5b40b1b27775 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 204 len: 0 microversion: 2.20 time: 0.570777 Jun 23 09:30:43.211436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 429/845] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jun 23 09:30:42 2022] DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 09:30:43.220708 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:43.221324 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:43.228374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:43.228775 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:43.229525 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:43.230022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:43.363890 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:43.372579 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:43.374097 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:43.375290 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8c482cf5-75e2-4c39-8beb-c6e42eda7d8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.158924 Jun 23 09:30:43.375841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 417/846] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:43 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 09:30:44.344045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:44.344636 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:44.351442 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:44.351868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:44.352700 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:44.353666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:44.377888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-70850122-8a14-4306-b48b-2d28b80dde68 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/ips" status: 200 len: 145 microversion: 2.1 time: 0.038176 Jun 23 09:30:44.378470 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 430/847] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:30:44 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:44.393619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:44.394232 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:44.401667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:44.402101 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:44.402868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:44.404243 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:44.540992 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:44.550645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:44.552184 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:44.553357 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-91d9652f-b911-4a77-a284-037d745e7896 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.163684 Jun 23 09:30:44.553953 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 418/848] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:44 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:30:45.572258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:45.572865 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:45.580320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:45.581020 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:45.581804 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:45.582234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:45.842078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:45.852633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:45.859888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:45.861263 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e355b5b5-eed9-4326-a980-f85546fa4ae5 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1723 microversion: 2.20 time: 0.292984 Jun 23 09:30:45.862591 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 431/849] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:45 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:30:46.037358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-d8164280-1b79-4909-b1a9-e4859adb480e req-f981baaa-2c1b-46a4-9f92-e929dc1c1ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84be6396-8e29-4b4e-a0c5-f15be7ee3d3f", "name": "network-vif-deleted", "tag": "732238d5-e9fb-41b3-9753-b880285a15e2"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:46.051766 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-d8164280-1b79-4909-b1a9-e4859adb480e req-f981baaa-2c1b-46a4-9f92-e929dc1c1ebe service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:46.058394 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-d8164280-1b79-4909-b1a9-e4859adb480e req-f981baaa-2c1b-46a4-9f92-e929dc1c1ebe service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:46.083036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-d8164280-1b79-4909-b1a9-e4859adb480e req-f981baaa-2c1b-46a4-9f92-e929dc1c1ebe service nova] Creating event network-vif-deleted:732238d5-e9fb-41b3-9753-b880285a15e2 for instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f on hv-cinder-84727 Jun 23 09:30:46.091056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-d8164280-1b79-4909-b1a9-e4859adb480e req-f981baaa-2c1b-46a4-9f92-e929dc1c1ebe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055080 Jun 23 09:30:46.093251 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 419/850] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:46.879923 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:46.880535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:46.887868 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:46.888324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:46.889091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:46.889534 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:46.934647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:46.935059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:46.935519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lazy-loading 'fault' on Instance uuid 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:30:46.982732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:46.992372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:46.994806 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30bc3dba44ed4d14a67e56aa640bf9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ece34041e04c78868e53d90b658a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:46.996252 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-64828211-c510-44f0-b679-5042e44a4754 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 200 len: 1371 microversion: 2.20 time: 0.120361 Jun 23 09:30:46.996832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 432/851] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:46 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 09:30:47.412606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cfeaef0-3ba7-436e-a3b5-a6d6261c99b5"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:47.413680 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:47.422597 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:47.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:47.423848 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:47.424281 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:48.014666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:48.015431 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:48.022115 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:48.022566 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:48.023364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:48.023803 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:48.037765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] HTTP exception thrown: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Request method failure captured: Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f HTTP/1.1 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDExk2CvKSkMvNreQBm9DmdOozNXfN19Wop-Q2SW5B8d1ew6nlBTGKLuMCEe8gimKbO3pG-F6JTOWskeatjIRpHomsdea2zJ9KcUumvAXuL3aZkrCbuBEzJWY4phi9tXNj14zayNtxRjPfG7ZNlSS-BGEUbQ9ShSM0ogmqhbgxNRQAE Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:30:48.041107 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29ece34041e04c78868e53d90b658a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29ece34041e04c78868e53d90b658a82", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 30bc3dba44ed4d14a67e56aa640bf9ca Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:48.042888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '84be6396-8e29-4b4e-a0c5-f15be7ee3d3f'} Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:30:48.043893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:48.045473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:48.046937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Returning 404 to user: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:30:48.046937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-df10b882-66e3-46ef-aaa2-fab7760b2977 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 404 len: 111 microversion: 2.20 time: 0.030279 Jun 23 09:30:48.046937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 433/852] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:48 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 09:30:48.052330 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-07f489e0-63d2-4455-ac75-28192469d8f6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '.version_select at 0x7f8270aa44c0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:48.159661 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-07f489e0-63d2-4455-ac75-28192469d8f6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292167913" status: 204 len: 0 microversion: 2.20 time: 0.112740 Jun 23 09:30:48.163832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 434/853] 10.222.0.52 () {60 vars in 1261 bytes} [Thu Jun 23 09:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292167913 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 09:30:48.284630 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d04a7e3a-9dbd-4807-9b75-680d7d8a75cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877007 Jun 23 09:30:48.285797 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 420/854] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:30:47 2022] POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:50.235337 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:50.235854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:50.243777 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:50.244239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:50.244995 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:50.245432 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:50.258517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] HTTP exception thrown: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Request method failure captured: Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f HTTP/1.1 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDExk2CvKSkMvNreQBm9DmdOozNXfN19Wop-Q2SW5B8d1ew6nlBTGKLuMCEe8gimKbO3pG-F6JTOWskeatjIRpHomsdea2zJ9KcUumvAXuL3aZkrCbuBEzJWY4phi9tXNj14zayNtxRjPfG7ZNlSS-BGEUbQ9ShSM0ogmqhbgxNRQAE Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:30:50.260745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29ece34041e04c78868e53d90b658a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29ece34041e04c78868e53d90b658a82", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 30bc3dba44ed4d14a67e56aa640bf9ca Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.262536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '84be6396-8e29-4b4e-a0c5-f15be7ee3d3f'} Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:30:50.263412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.265078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.266611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Returning 404 to user: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:30:50.266611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-62197d77-78ba-4953-ab64-e4b591ee26a6 tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 404 len: 111 microversion: 2.20 time: 0.031274 Jun 23 09:30:50.266611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 435/855] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jun 23 09:30:50 2022] DELETE /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:30:50.271913 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:50.272681 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:50.278985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:50.279443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:50.280242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:50.280688 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:50.293694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] HTTP exception thrown: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Request method failure captured: Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f HTTP/1.1 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDExk2CvKSkMvNreQBm9DmdOozNXfN19Wop-Q2SW5B8d1ew6nlBTGKLuMCEe8gimKbO3pG-F6JTOWskeatjIRpHomsdea2zJ9KcUumvAXuL3aZkrCbuBEzJWY4phi9tXNj14zayNtxRjPfG7ZNlSS-BGEUbQ9ShSM0ogmqhbgxNRQAE Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:30:50.295318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29ece34041e04c78868e53d90b658a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29ece34041e04c78868e53d90b658a82", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 30bc3dba44ed4d14a67e56aa640bf9ca Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.297012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '84be6396-8e29-4b4e-a0c5-f15be7ee3d3f'} Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:30:50.298117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. Jun 23 09:30:50.299422 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:50.300712 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Returning 404 to user: Instance 84be6396-8e29-4b4e-a0c5-f15be7ee3d3f could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:30:50.300712 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-422d0d6c-a154-4dae-810d-63cfe60daf8b tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f" status: 404 len: 111 microversion: 2.20 time: 0.029606 Jun 23 09:30:50.300712 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 421/856] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:50 2022] GET /compute/v2.1/servers/84be6396-8e29-4b4e-a0c5-f15be7ee3d3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 09:30:51.622528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:51.623059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:51.629547 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:51.630003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:51.630765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:51.631230 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:51.644911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] HTTP exception thrown: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Request method failure captured: Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b HTTP/1.1 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDExk2CvKSkMvNreQBm9DmdOozNXfN19Wop-Q2SW5B8d1ew6nlBTGKLuMCEe8gimKbO3pG-F6JTOWskeatjIRpHomsdea2zJ9KcUumvAXuL3aZkrCbuBEzJWY4phi9tXNj14zayNtxRjPfG7ZNlSS-BGEUbQ9ShSM0ogmqhbgxNRQAE Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:30:51.646599 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29ece34041e04c78868e53d90b658a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29ece34041e04c78868e53d90b658a82", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 30bc3dba44ed4d14a67e56aa640bf9ca Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.654193 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'bd6f6f87-f812-4fe4-98a4-86bab5a8d39b'} Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:30:51.655504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.657068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.658619 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Returning 404 to user: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:30:51.658619 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ef3f6700-d0ce-43f5-aa8b-78d1da538bcb tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 404 len: 111 microversion: 2.20 time: 0.029395 Jun 23 09:30:51.658619 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 436/857] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jun 23 09:30:51 2022] DELETE /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:30:51.659257 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:51.659872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] [instance: bd6f6f87-f812-4fe4-98a4-86bab5a8d39b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:51.666262 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:51.666712 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:51.667500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:51.667940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:51.681496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] HTTP exception thrown: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Request method failure captured: Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b HTTP/1.1 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDExk2CvKSkMvNreQBm9DmdOozNXfN19Wop-Q2SW5B8d1ew6nlBTGKLuMCEe8gimKbO3pG-F6JTOWskeatjIRpHomsdea2zJ9KcUumvAXuL3aZkrCbuBEzJWY4phi9tXNj14zayNtxRjPfG7ZNlSS-BGEUbQ9ShSM0ogmqhbgxNRQAE Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:30:51.683058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29ece34041e04c78868e53d90b658a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29ece34041e04c78868e53d90b658a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29ece34041e04c78868e53d90b658a82", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 29ece34041e04c78868e53d90b658a82 Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546510538 Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 30bc3dba44ed4d14a67e56aa640bf9ca Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546510538-project Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.684885 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'bd6f6f87-f812-4fe4-98a4-86bab5a8d39b'} Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:30:51.685939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. Jun 23 09:30:51.690012 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:30:51.691446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] Returning 404 to user: Instance bd6f6f87-f812-4fe4-98a4-86bab5a8d39b could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:30:51.691446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4a12af10-7593-4a3b-b621-a76e0e2eb54f tempest-AttachVolumeShelveTestJSON-546510538 tempest-AttachVolumeShelveTestJSON-546510538-project] 10.222.0.52 "GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b" status: 404 len: 111 microversion: 2.20 time: 0.028911 Jun 23 09:30:51.691446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 422/858] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jun 23 09:30:51 2022] GET /compute/v2.1/servers/bd6f6f87-f812-4fe4-98a4-86bab5a8d39b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 09:30:56.091089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1704402911"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:56.091670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:56.099004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:56.099454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:56.100210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:56.100642 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:56.233820 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.network.security_group_api [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Removing security group 657e3f01-8440-433b-9546-47422b69f308 from port 22e31120-c9ad-4071-b7c6-4a5042d14b7c Jun 23 09:30:56.669110 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f9796308-c54e-4808-ba9b-74be028aaa05 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/action" status: 202 len: 0 microversion: 2.1 time: 0.582057 Jun 23 09:30:56.716035 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 437/859] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:30:56 2022] POST /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:30:56.717240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-7c41fc82-1186-432c-b235-ace05732fb15 req-17f83b6b-646e-46cf-999e-8e13469f9b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:56.717240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-7c41fc82-1186-432c-b235-ace05732fb15 req-17f83b6b-646e-46cf-999e-8e13469f9b57 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:56.717240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-7c41fc82-1186-432c-b235-ace05732fb15 req-17f83b6b-646e-46cf-999e-8e13469f9b57 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:56.735993 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-7c41fc82-1186-432c-b235-ace05732fb15 req-17f83b6b-646e-46cf-999e-8e13469f9b57 service nova] Creating event network-changed:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:30:56.749508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-7c41fc82-1186-432c-b235-ace05732fb15 req-17f83b6b-646e-46cf-999e-8e13469f9b57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069360 Jun 23 09:30:56.755876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 423/860] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:30:56.922173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-79c8a753-3b55-4985-a654-a01428aa5b66 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:56.933151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-79c8a753-3b55-4985-a654-a01428aa5b66 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:56.933435 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-79c8a753-3b55-4985-a654-a01428aa5b66 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:57.029994 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-79c8a753-3b55-4985-a654-a01428aa5b66 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Going to try to stop instance {{(pid=118500) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 09:30:57.228462 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-79c8a753-3b55-4985-a654-a01428aa5b66 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action" status: 202 len: 0 microversion: 2.1 time: 0.309822 Jun 23 09:30:57.229220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 438/861] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:30:56 2022] POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:30:57.237631 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:57.238339 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:57.247390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:57.247846 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:57.248671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:57.249086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:57.390809 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-93943bc5-5342-464b-b49e-c9fb4b9e8dcb tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Action: 'create', calling method: .version_select at 0x7f82709bf160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1188474446"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:57.472290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:57.480175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b8b9c517-c7db-4578-abad-f3080ca52b0a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.246876 Jun 23 09:30:57.481083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 439/862] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:57 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:58.103644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:58.104146 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:58.110811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.123415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.123415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.123415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.205485 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lazy-loading 'services' on Instance uuid 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:30:58.211031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-93943bc5-5342-464b-b49e-c9fb4b9e8dcb tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.977449 Jun 23 09:30:58.211031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 424/863] 10.222.0.52 () {60 vars in 1154 bytes} [Thu Jun 23 09:30:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 979 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 23 09:30:58.211031 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-dfe2a975-a060-43b9-b92d-90be023213d6 req-15fd872e-2952-4584-b361-d029044cbb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:58.220788 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-dfe2a975-a060-43b9-b92d-90be023213d6 req-15fd872e-2952-4584-b361-d029044cbb49 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.221392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-dfe2a975-a060-43b9-b92d-90be023213d6 req-15fd872e-2952-4584-b361-d029044cbb49 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.232500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-dfe2a975-a060-43b9-b92d-90be023213d6 req-15fd872e-2952-4584-b361-d029044cbb49 service nova] Creating event network-changed:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:30:58.237914 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-dfe2a975-a060-43b9-b92d-90be023213d6 req-15fd872e-2952-4584-b361-d029044cbb49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031169 Jun 23 09:30:58.239005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 425/864] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:58.245412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-246322de-0b6b-449f-a4a8-04c799630963 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270917dc0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:58.301284 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-246322de-0b6b-449f-a4a8-04c799630963 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 200 len: 345 microversion: 2.1 time: 0.060208 Jun 23 09:30:58.301929 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 426/865] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:30:58 2022] GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:58.489964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0b82dbc5-786c-4d6e-8248-4797e3a423af tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments/ca7603d2-e70c-4983-9ffb-e35c74b7cc51" status: 202 len: 0 microversion: 2.1 time: 0.391669 Jun 23 09:30:58.495095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 440/866] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:30:58 2022] DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments/ca7603d2-e70c-4983-9ffb-e35c74b7cc51 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:30:58.499157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:58.500040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:58.513949 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.516508 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.518091 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.519606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:58.520190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.525957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:58.533905 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.537082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.539609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:58.540279 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:58.599604 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5bbf8324-4fc5-4902-9052-378490cfe3bf tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095486 Jun 23 09:30:58.600673 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 441/867] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:30:58 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:58.701642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:58.713665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-eb44daba-4ff1-4f38-9a31-60547b0e92dd tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.217614 Jun 23 09:30:58.724704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 427/868] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:58 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:30:59.313933 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-19e4c03c-f70b-4c84-bc31-994223608b98 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270b30280>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:59.363254 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-19e4c03c-f70b-4c84-bc31-994223608b98 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 200 len: 346 microversion: 2.1 time: 0.053351 Jun 23 09:30:59.363823 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 442/869] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:30:59 2022] GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:59.375081 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2714e0cf-540f-4d90-b1d9-4b52959924fb tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Action: 'create', calling method: .version_select at 0x7f8270917310>, body: {"snapshot": {"volume_id": "98a52219-8517-4abf-b149-8f6f67d23b4e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1791891593"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:30:59.611673 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:59.612854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:59.619515 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:59.619966 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:59.620719 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:59.621155 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:59.649966 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-94b7c2d2-94aa-4a47-80ee-f5b4f21af133 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Jun 23 09:30:59.650676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 443/870] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:30:59 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:30:59.731452 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:59.732062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:30:59.738360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:59.738808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:59.739592 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:30:59.740027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:30:59.880223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:30:59.888290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c68c7b32-a8ce-4457-8ff4-3a6da8a111b5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.160734 Jun 23 09:30:59.888851 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 444/871] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:30:59 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:30:59.931828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2714e0cf-540f-4d90-b1d9-4b52959924fb tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.560684 Jun 23 09:30:59.933471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 428/872] 10.222.0.52 () {60 vars in 1161 bytes} [Thu Jun 23 09:30:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:30:59.942889 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-687f8f15-0687-4437-a5b0-e6b6bcd91f8f tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270ac5a60>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:30:59.972120 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-687f8f15-0687-4437-a5b0-e6b6bcd91f8f tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 200 len: 287 microversion: 2.1 time: 0.033448 Jun 23 09:30:59.972685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 445/873] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:30:59 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:30:59.982808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1579676b-089a-44fc-9767-c32416539a71 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f82708d45e0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:00.011420 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1579676b-089a-44fc-9767-c32416539a71 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032266 Jun 23 09:31:00.011982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 429/874] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Jun 23 09:30:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:00.021867 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fb0ff2e9-eb33-4312-88cb-fcbb4fffdf74 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270ac5ca0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:00.053034 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fb0ff2e9-eb33-4312-88cb-fcbb4fffdf74 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 200 len: 287 microversion: 2.1 time: 0.034924 Jun 23 09:31:00.053612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 446/875] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:31:00 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:00.661357 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:00.662269 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:00.668998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:00.669442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:00.670193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:00.670623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:00.697534 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ad498daf-0fff-4528-8891-2b58ffe214d3 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040160 Jun 23 09:31:00.698075 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 430/876] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:31:00 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:31:00.708867 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:00.709383 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:00.716877 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:00.717328 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:00.718090 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:00.718530 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:00.789465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] HTTP exception thrown: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 is not attached to volume ca7603d2-e70c-4983-9ffb-e35c74b7cc51 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Request method failure captured: Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments/ca7603d2-e70c-4983-9ffb-e35c74b7cc51 HTTP/1.1 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDI4T9jjSQgDV2HFnjWCYfyQ-jYEsEaCRWW446SwaWJWYExskXfZQDA-v6LaFwkQfan5tXnkNMV8CX2B_nIdffPOYEnkzmNv4ytHVwXMcH4y9BtSO3OcmMPE6VeLQcwMa6Bq1QBRMCXl2hXnHcXBle5frb3XpF6e8Uuq-UPPyDocle0 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: f17a6a1110a2462b98908ecbc67564f9 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-TestMinimumBasicScenario-252391469 Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:00.815233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f17a6a1110a2462b98908ecbc67564f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f17a6a1110a2462b98908ecbc67564f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f17a6a1110a2462b98908ecbc67564f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f17a6a1110a2462b98908ecbc67564f9", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-TestMinimumBasicScenario-252391469 Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: f17a6a1110a2462b98908ecbc67564f9 Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-TestMinimumBasicScenario-252391469 Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-TestMinimumBasicScenario-252391469-project Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: fc1a2967d343413d8eb72de6a49ba653 Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-TestMinimumBasicScenario-252391469-project Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:00.817016 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 is not attached to volume ca7603d2-e70c-4983-9ffb-e35c74b7cc51 Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'server_id': '159bdef5-d7bd-4d8f-8d96-2176aa3c53a2', 'id': 'ca7603d2-e70c-4983-9ffb-e35c74b7cc51'} Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ca7603d2-e70c-4983-9ffb-e35c74b7cc51. Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:00.817828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 is not attached to volume ca7603d2-e70c-4983-9ffb-e35c74b7cc51 Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 is not attached to volume ca7603d2-e70c-4983-9ffb-e35c74b7cc51 Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:00.819390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Returning 404 to user: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 is not attached to volume ca7603d2-e70c-4983-9ffb-e35c74b7cc51 {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:00.820573 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-290fa181-01d8-4948-bea8-c2da53540cae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments/ca7603d2-e70c-4983-9ffb-e35c74b7cc51" status: 404 len: 154 microversion: 2.1 time: 0.112373 Jun 23 09:31:00.820573 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 447/877] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:31:00 2022] DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2/os-volume_attachments/ca7603d2-e70c-4983-9ffb-e35c74b7cc51 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:00.905337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:00.905941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:00.912366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:00.912753 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:00.913501 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:00.913934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:01.048327 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:01.056405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ed7708a4-d300-4cd9-8c28-d26141c1324e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.154933 Jun 23 09:31:01.056983 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 431/878] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:00 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:01.071930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cb02107d-40ba-4539-9075-71f06f105978 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270ac50d0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:01.101209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cb02107d-40ba-4539-9075-71f06f105978 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 200 len: 287 microversion: 2.1 time: 0.033128 Jun 23 09:31:01.101775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 448/879] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:31:01 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:02.075414 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:02.076032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:02.082445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:02.084345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:02.084345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:02.084345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:02.114357 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7d58e6c3-c02f-4dab-9bba-179017db45de tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270995700>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:02.147607 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7d58e6c3-c02f-4dab-9bba-179017db45de tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 200 len: 287 microversion: 2.1 time: 0.037678 Jun 23 09:31:02.148210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 449/880] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:31:02 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:31:02.219633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:02.227700 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-aa769aab-5515-4521-badc-5eb5a53edc8d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.156790 Jun 23 09:31:02.228271 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 432/881] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:02 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:02.512899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:02.513395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:02.519441 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:02.519894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:02.520692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:02.521132 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:02.537229 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:02.543674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f2e0618f-35fd-4e30-9842-aff0b5ab69e9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/ips" status: 200 len: 149 microversion: 2.1 time: 0.140102 Jun 23 09:31:02.544213 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 450/882] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:31:02 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/ips => generated 149 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:03.163317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-352ab959-efc9-414d-a24a-619756abd986 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270966ca0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:03.200022 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-352ab959-efc9-414d-a24a-619756abd986 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 200 len: 287 microversion: 2.1 time: 0.040533 Jun 23 09:31:03.200593 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 433/883] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:31:03 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:03.245885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:03.246586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:03.253893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:03.254475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:03.255313 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:03.255820 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:03.467591 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:03.475691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-80b549dd-e089-4cf0-8c51-605edb1da38b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.234246 Jun 23 09:31:03.476581 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 451/884] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:03 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:04.126403 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25d7acd4-2cdf-4dd9-bce3-941fb8bc5d78"}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:04.127625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:04.134869 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.135358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.136131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.136570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.213859 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-43f0f0a8-335f-4ae6-bf47-d4134abe8846 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270ac5d30>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:04.244042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-43f0f0a8-335f-4ae6-bf47-d4134abe8846 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 200 len: 288 microversion: 2.1 time: 0.035527 Jun 23 09:31:04.244686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 452/885] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:31:04 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:31:04.257602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e041ff2e-784e-4433-8378-ec163eaf3267 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f82709ec5e0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:04.387985 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e041ff2e-784e-4433-8378-ec163eaf3267 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 202 len: 0 microversion: 2.1 time: 0.134754 Jun 23 09:31:04.388645 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 453/886] 10.222.0.52 () {58 vars in 1253 bytes} [Thu Jun 23 09:31:04 2022] DELETE /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:31:04.393350 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:04.393834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:04.401317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.401754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.405878 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.407154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.436765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:31:04.793536 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3233b45a-acbc-4952-8636-9e6bd1226f38 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 204 len: 0 microversion: 2.1 time: 0.403434 Jun 23 09:31:04.794454 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 454/887] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:04 2022] DELETE /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:31:04.799781 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6d4544ed-c637-463a-920d-2e141981217a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270ac5430>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:04.825532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-6d4544ed-c637-463a-920d-2e141981217a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] HTTP exception thrown: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6d4544ed-c637-463a-920d-2e141981217a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Request method failure captured: Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 HTTP/1.1 Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDLRYxKjpLeGIIuIqzokummYJG2IVR8NOPnzElkguuXTTrL8FlTV0quEypShEc0xKOA8POqJFf0UJgYArXZ-ELFp0-ZLgkBdRWubjVLrcGnV4mMZJpl5gLjdh47jz63Px5mxL7ugdVYdYG-teXAg31dgD_fbeHzHFYUMlZCrlh0U3oM Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:04.827907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd36fda2fe544388b2392365bb4cb04d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: a73ba0b50a5244208b64d73268a516e9 Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'e3d886f5-65d4-4b94-8404-91021e68d008'} Jun 23 09:31:04.829587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. (HTTP 404) (Request-ID: req-e85ab86a-dc50-4f37-bcac-0a372545e032) Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.833690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:31:04.835194 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 09:31:04.836693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6d4544ed-c637-463a-920d-2e141981217a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Returning 404 to user: Snapshot e3d886f5-65d4-4b94-8404-91021e68d008 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6d4544ed-c637-463a-920d-2e141981217a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008" status: 404 len: 111 microversion: 2.1 time: 0.033945 Jun 23 09:31:04.838189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 455/888] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:31:04 2022] GET /compute/v2.1/os-snapshots/e3d886f5-65d4-4b94-8404-91021e68d008 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:04.849046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:04.849046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:04.849046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.849046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.849410 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.849410 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.967670 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1a6af0a8-3074-4660-bc9f-94b14611d770 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "POST /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844990 Jun 23 09:31:04.972960 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 434/889] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:31:04 2022] POST /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:04.973243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:04.978613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:04.979521 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:04.987884 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.988333 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.989102 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:04.989536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:04.994040 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ded76887-2451-4af8-a5d5-0ff225df9a6d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.162544 Jun 23 09:31:04.995209 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 456/890] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:04 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:05.000152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b9fb20a8-55dc-420a-a498-bdb7485af693 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f82709ec5e0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:05.149757 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:05.157343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2a71259d-a715-42a7-9cb4-b78e7a7e1a1c tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1555 microversion: 2.1 time: 0.187667 Jun 23 09:31:05.157908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 435/891] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:04 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:05.209378 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b9fb20a8-55dc-420a-a498-bdb7485af693 tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 202 len: 0 microversion: 2.1 time: 0.212983 Jun 23 09:31:05.210101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 457/892] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:31:04 2022] DELETE /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:31:05.218935 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-327cde6b-47a6-4479-9135-46265f23aaeb tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270a62310>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:05.265445 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-327cde6b-47a6-4479-9135-46265f23aaeb tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 200 len: 345 microversion: 2.1 time: 0.050285 Jun 23 09:31:05.266006 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 436/893] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:31:05 2022] GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:06.014204 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:06.014739 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:06.020777 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:06.021224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:06.022012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:06.022448 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:06.151715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:06.159710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6f49a2a2-0611-496e-ac3b-acdf5b7cf798 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.149905 Jun 23 09:31:06.160269 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 458/894] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:06 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:06.175660 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:06.176272 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:06.182730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:06.183211 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:06.183971 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:06.184407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:06.277763 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3506c971-16e2-4674-9efc-788bc524d01a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f82709ec940>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:06.304573 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-3506c971-16e2-4674-9efc-788bc524d01a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] HTTP exception thrown: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3506c971-16e2-4674-9efc-788bc524d01a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Request method failure captured: Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e HTTP/1.1 Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDLRYxKjpLeGIIuIqzokummYJG2IVR8NOPnzElkguuXTTrL8FlTV0quEypShEc0xKOA8POqJFf0UJgYArXZ-ELFp0-ZLgkBdRWubjVLrcGnV4mMZJpl5gLjdh47jz63Px5mxL7ugdVYdYG-teXAg31dgD_fbeHzHFYUMlZCrlh0U3oM Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:06.307306 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd36fda2fe544388b2392365bb4cb04d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: a73ba0b50a5244208b64d73268a516e9 Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '98a52219-8517-4abf-b149-8f6f67d23b4e'} Jun 23 09:31:06.309038 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. (HTTP 404) (Request-ID: req-704ffc53-cebf-487e-b0cc-c195b1b770ac) Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.310145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:31:06.312113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 09:31:06.313455 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3506c971-16e2-4674-9efc-788bc524d01a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Returning 404 to user: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3506c971-16e2-4674-9efc-788bc524d01a tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 404 len: 109 microversion: 2.1 time: 0.035108 Jun 23 09:31:06.314875 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 459/895] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:31:06 2022] GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:31:06.316176 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:06.322207 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-001930e6-74eb-44fe-9b83-f90dabd74aae tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1555 microversion: 2.1 time: 0.150743 Jun 23 09:31:06.322779 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 437/896] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:06 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:06.325443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3d1d2ca0-417c-4be1-a9d9-93e185c6320b tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f8270aa4940>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:06.351641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-3d1d2ca0-417c-4be1-a9d9-93e185c6320b tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] HTTP exception thrown: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3d1d2ca0-417c-4be1-a9d9-93e185c6320b tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Request method failure captured: Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e HTTP/1.1 Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDLRYxKjpLeGIIuIqzokummYJG2IVR8NOPnzElkguuXTTrL8FlTV0quEypShEc0xKOA8POqJFf0UJgYArXZ-ELFp0-ZLgkBdRWubjVLrcGnV4mMZJpl5gLjdh47jz63Px5mxL7ugdVYdYG-teXAg31dgD_fbeHzHFYUMlZCrlh0U3oM Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:06.354116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd36fda2fe544388b2392365bb4cb04d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: a73ba0b50a5244208b64d73268a516e9 Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '98a52219-8517-4abf-b149-8f6f67d23b4e'} Jun 23 09:31:06.355856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. (HTTP 404) (Request-ID: req-e695b9d6-ddb9-410d-8c2b-e3798584a4d0) Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.357062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 09:31:06.358672 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 09:31:06.365008 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3d1d2ca0-417c-4be1-a9d9-93e185c6320b tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Returning 404 to user: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3d1d2ca0-417c-4be1-a9d9-93e185c6320b tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 404 len: 109 microversion: 2.1 time: 0.036752 Jun 23 09:31:06.366849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 460/897] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:31:06 2022] DELETE /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:31:06.371269 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-04516a6f-7954-4cda-b7ad-18daf4b724ca tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Calling method '.version_select at 0x7f82709a09d0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:06.400565 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-04516a6f-7954-4cda-b7ad-18daf4b724ca tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] HTTP exception thrown: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-04516a6f-7954-4cda-b7ad-18daf4b724ca tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Request method failure captured: Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e HTTP/1.1 Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDLRYxKjpLeGIIuIqzokummYJG2IVR8NOPnzElkguuXTTrL8FlTV0quEypShEc0xKOA8POqJFf0UJgYArXZ-ELFp0-ZLgkBdRWubjVLrcGnV4mMZJpl5gLjdh47jz63Px5mxL7ugdVYdYG-teXAg31dgD_fbeHzHFYUMlZCrlh0U3oM Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:31:06.413023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd36fda2fe544388b2392365bb4cb04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd36fda2fe544388b2392365bb4cb04d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: dd36fda2fe544388b2392365bb4cb04d Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-142931710 Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: a73ba0b50a5244208b64d73268a516e9 Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesSnapshotsTestJSON-142931710-project Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '98a52219-8517-4abf-b149-8f6f67d23b4e'} Jun 23 09:31:06.415283 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. (HTTP 404) (Request-ID: req-15011921-fd0c-4651-b003-13641325d7b0) Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.416328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:31:06.417816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 09:31:06.419421 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-04516a6f-7954-4cda-b7ad-18daf4b724ca tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] Returning 404 to user: Volume 98a52219-8517-4abf-b149-8f6f67d23b4e could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-04516a6f-7954-4cda-b7ad-18daf4b724ca tempest-VolumesSnapshotsTestJSON-142931710 tempest-VolumesSnapshotsTestJSON-142931710-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e" status: 404 len: 109 microversion: 2.1 time: 0.047771 Jun 23 09:31:06.420925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 438/898] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:31:06 2022] GET /compute/v2.1/os-volumes/98a52219-8517-4abf-b149-8f6f67d23b4e => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:07.177863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:07.179332 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:07.186274 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:07.186992 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:07.187776 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:07.188415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:07.341185 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:07.341791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:07.348608 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:07.349054 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:07.349844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:07.350251 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:07.385175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:07.393371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9b52779c-0655-4e25-a439-7d3e5d819f46 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.219956 Jun 23 09:31:07.393943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 461/899] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:07 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:07.497306 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:07.505502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f94b6cc5-34d2-428f-8ad0-9d217f8416a4 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1555 microversion: 2.1 time: 0.168777 Jun 23 09:31:07.506252 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 439/900] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:07 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:31:07.577035 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-542a5d23-6d82-4db7-9796-d45a39f47bf1 req-3f7d926d-e447-4413-bb66-d6902b1000c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159bdef5-d7bd-4d8f-8d96-2176aa3c53a2", "name": "network-vif-deleted", "tag": "22e31120-c9ad-4071-b7c6-4a5042d14b7c"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:07.585499 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-542a5d23-6d82-4db7-9796-d45a39f47bf1 req-3f7d926d-e447-4413-bb66-d6902b1000c7 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:07.586028 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-542a5d23-6d82-4db7-9796-d45a39f47bf1 req-3f7d926d-e447-4413-bb66-d6902b1000c7 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:07.598774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-542a5d23-6d82-4db7-9796-d45a39f47bf1 req-3f7d926d-e447-4413-bb66-d6902b1000c7 service nova] Creating event network-vif-deleted:22e31120-c9ad-4071-b7c6-4a5042d14b7c for instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 on hv-cinder-84727 Jun 23 09:31:07.604116 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-542a5d23-6d82-4db7-9796-d45a39f47bf1 req-3f7d926d-e447-4413-bb66-d6902b1000c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030814 Jun 23 09:31:07.604708 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 462/901] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:08.409477 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:08.410113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:08.416554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:08.417004 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:08.417777 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:08.418214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:08.422334 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:08.523195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:08.524019 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:08.530471 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:08.530952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:08.533195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:08.533195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:08.554258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:08.563648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:08.564103 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:08.564557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lazy-loading 'fault' on Instance uuid 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:31:08.574457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2183bd2a-821d-45c4-bbba-2142df05e0e1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.158064 Jun 23 09:31:08.575426 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 440/902] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:08 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:08.613229 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1a2967d343413d8eb72de6a49ba653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17a6a1110a2462b98908ecbc67564f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:08.621671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-eb398f24-8b4c-45ea-8a3a-27122af561d6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 200 len: 1348 microversion: 2.1 time: 0.103266 Jun 23 09:31:08.622238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 463/903] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:08 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:31:09.592705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:09.593312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:09.600191 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:09.600639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:09.601435 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:09.601868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:09.638495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:09.639181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] [instance: 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:09.647151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:09.647151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:09.647151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:09.648333 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:09.661914 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] HTTP exception thrown: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 could not be found. Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Request method failure captured: Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 HTTP/1.1 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDI4T9jjSQgDV2HFnjWCYfyQ-jYEsEaCRWW446SwaWJWYExskXfZQDA-v6LaFwkQfan5tXnkNMV8CX2B_nIdffPOYEnkzmNv4ytHVwXMcH4y9BtSO3OcmMPE6VeLQcwMa6Bq1QBRMCXl2hXnHcXBle5frb3XpF6e8Uuq-UPPyDocle0 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: f17a6a1110a2462b98908ecbc67564f9 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-TestMinimumBasicScenario-252391469 Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:09.663589 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f17a6a1110a2462b98908ecbc67564f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f17a6a1110a2462b98908ecbc67564f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f17a6a1110a2462b98908ecbc67564f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f17a6a1110a2462b98908ecbc67564f9", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-TestMinimumBasicScenario-252391469 Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: f17a6a1110a2462b98908ecbc67564f9 Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-TestMinimumBasicScenario-252391469 Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-TestMinimumBasicScenario-252391469-project Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: fc1a2967d343413d8eb72de6a49ba653 Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-TestMinimumBasicScenario-252391469-project Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 could not be found. Jun 23 09:31:09.665480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '159bdef5-d7bd-4d8f-8d96-2176aa3c53a2'} Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 could not be found. Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:09.666842 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 could not be found. Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 could not be found. Jun 23 09:31:09.668285 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:09.670323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Returning 404 to user: Instance 159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:09.670323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7d791bd5-1750-4fe4-8b47-349f00805db6 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2" status: 404 len: 111 microversion: 2.1 time: 0.030471 Jun 23 09:31:09.670323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 464/904] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:09 2022] GET /compute/v2.1/servers/159bdef5-d7bd-4d8f-8d96-2176aa3c53a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:31:09.674763 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d1211778-8a20-4165-8be0-6bdb5cc1b298 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] Calling method '.version_select at 0x7f8270995280>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:09.735726 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:09.744858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9e7ce422-ac9c-4512-88f0-b55310c4f1d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.156213 Jun 23 09:31:09.745426 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 441/905] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:09 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:09.799473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d1211778-8a20-4165-8be0-6bdb5cc1b298 tempest-TestMinimumBasicScenario-252391469 tempest-TestMinimumBasicScenario-252391469-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-702940458" status: 202 len: 0 microversion: 2.1 time: 0.129032 Jun 23 09:31:09.800045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 465/906] 10.222.0.52 () {58 vars in 1268 bytes} [Thu Jun 23 09:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-702940458 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:31:10.761835 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:10.762386 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:10.768908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:10.769407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:10.770191 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:10.770634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:10.910747 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:10.918694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2ebac153-e43d-461a-8f03-4f041a7b8dc8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.160797 Jun 23 09:31:10.919289 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 442/907] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:10 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:11.936633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:11.937248 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:11.944523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:11.944979 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:11.945745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:11.946197 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:12.076162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:12.085282 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4079362f-f812-476e-9b84-672e6dbc5dcc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1722 microversion: 2.1 time: 0.152704 Jun 23 09:31:12.086143 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 466/908] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:11 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:13.103284 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:13.103911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:13.110574 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:13.111272 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:13.112046 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:13.112734 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:13.272871 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:13.282642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3a912a13-0791-4d49-ba7d-53d68c3593d5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1699 microversion: 2.1 time: 0.183724 Jun 23 09:31:13.284467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 443/909] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:13 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:13.300189 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-748a9031-c56e-404f-b0ad-a3ca5b9e1777 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:13.302742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:13.307880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-748a9031-c56e-404f-b0ad-a3ca5b9e1777 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:13.308338 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-748a9031-c56e-404f-b0ad-a3ca5b9e1777 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:13.344824 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-748a9031-c56e-404f-b0ad-a3ca5b9e1777 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Going to try to start instance {{(pid=118500) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 09:31:13.617704 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-748a9031-c56e-404f-b0ad-a3ca5b9e1777 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action" status: 202 len: 0 microversion: 2.1 time: 0.314581 Jun 23 09:31:13.619647 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 467/910] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:31:13 2022] POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:31:13.631343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:13.632154 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:13.639320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:13.639986 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:13.640801 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:13.641240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:13.839327 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:13.847395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4db6beaf-464e-44e0-bd21-368fdff99646 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1708 microversion: 2.1 time: 0.220245 Jun 23 09:31:13.847969 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 444/911] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:13 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1708 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:14.871246 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:14.872535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:14.902559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:14.905220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:14.906027 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:14.906465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:14.917679 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:14.918225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:14.924703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=45 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:14.931856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:14.932444 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:14.933277 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:14.933879 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:15.040160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'services' on Instance uuid a07552f3-8f05-43be-9c71-115133c1efbf {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:31:15.166223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:15.176507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-18952805-73a8-48c3-9945-011a2292e31f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1708 microversion: 2.1 time: 0.314655 Jun 23 09:31:15.178330 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 468/912] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:14 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1708 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:15.401025 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b298d2cd-2d4c-48ee-a677-d30a52e8cb81 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments/25d7acd4-2cdf-4dd9-bce3-941fb8bc5d78" status: 202 len: 0 microversion: 2.1 time: 0.480511 Jun 23 09:31:15.401025 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 445/913] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:31:14 2022] DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments/25d7acd4-2cdf-4dd9-bce3-941fb8bc5d78 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:31:15.401243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:15.402291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:15.409596 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:15.410123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:15.410996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:15.411514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:15.451176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fbcc63a9-48a8-48ff-9f4c-ccf2aca3c95c tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Jun 23 09:31:15.451176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 469/914] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:31:15 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:16.197021 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:16.197730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:16.204231 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:16.205082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:16.205520 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:16.205958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:16.345607 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:16.355599 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e939fa8f-d869-4728-84f8-3f05a8eaf8f9 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1712 microversion: 2.1 time: 0.163799 Jun 23 09:31:16.356824 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 446/915] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:16 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1712 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:16.457937 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:16.459703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:16.467407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:16.467854 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:16.468620 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:16.469296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:16.519644 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-5ade7c04-e279-402a-8a26-03db72079096 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065695 Jun 23 09:31:16.520874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 470/916] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:31:16 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:17.532182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:17.533160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:17.542806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:17.550221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:17.550221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:17.550221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:17.576193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e8f8f1ba-040d-43aa-8ad4-e3b26e88b618 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047974 Jun 23 09:31:17.577024 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 447/917] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:31:17 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:31:17.646460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:17.647113 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:17.653635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:17.654211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:17.655153 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:17.655701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:17.683982 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:31:17.732532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:18.124443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d50f011b-1149-44f3-bd27-4874f6e59bf9 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 204 len: 0 microversion: 2.1 time: 0.481771 Jun 23 09:31:18.125815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 471/918] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:17 2022] DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:31:18.134130 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:18.135440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:18.146546 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:18.147131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:18.147921 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:18.148358 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:18.310789 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:18.321104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d0115448-22d7-43f7-99e0-ba118e5510ff tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1682 microversion: 2.1 time: 0.191137 Jun 23 09:31:18.322316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 448/919] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:18 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:19.339831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:19.340511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:19.348341 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:19.348793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:19.349809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:19.350251 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:19.580302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:19.588446 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-01709895-9e1d-4364-a24e-e565c6a1f235 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1682 microversion: 2.1 time: 0.253347 Jun 23 09:31:19.589097 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 472/920] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:19 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:20.612263 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:20.613407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:20.622267 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:20.622715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:20.623597 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:20.624030 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:20.662412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-68c08d2e-cf50-4b81-9633-f25b3316aa09 req-10b67274-80e2-48e6-83d4-7c4bab9d2139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07552f3-8f05-43be-9c71-115133c1efbf", "name": "network-vif-deleted", "tag": "c9d1a564-114e-4aa5-8d8c-8f2812e40962"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:20.684022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-68c08d2e-cf50-4b81-9633-f25b3316aa09 req-10b67274-80e2-48e6-83d4-7c4bab9d2139 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:20.684272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-68c08d2e-cf50-4b81-9633-f25b3316aa09 req-10b67274-80e2-48e6-83d4-7c4bab9d2139 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:20.700040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:20.707942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b4a8b1e4-acb2-46c4-85fa-cbec25671680 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1614 microversion: 2.1 time: 0.106082 Jun 23 09:31:20.708892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-68c08d2e-cf50-4b81-9633-f25b3316aa09 req-10b67274-80e2-48e6-83d4-7c4bab9d2139 service nova] Creating event network-vif-deleted:c9d1a564-114e-4aa5-8d8c-8f2812e40962 for instance a07552f3-8f05-43be-9c71-115133c1efbf on hv-cinder-84727 Jun 23 09:31:20.709906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 449/921] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:20 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1614 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:20.721207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-68c08d2e-cf50-4b81-9633-f25b3316aa09 req-10b67274-80e2-48e6-83d4-7c4bab9d2139 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063078 Jun 23 09:31:20.723460 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 473/922] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:31:21.726847 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:21.727509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:21.733581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:21.734040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:21.734805 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:21.735274 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:21.776986 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:21.777837 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:21.778505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lazy-loading 'fault' on Instance uuid a07552f3-8f05-43be-9c71-115133c1efbf {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:31:21.824571 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5452341ccc40bc94b38369dae4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0795f7c61d497c9b25c7e17ad08744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:21.832563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3ebf659a-439e-4d2e-8b1e-4a5b231b2d7d tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 200 len: 1332 microversion: 2.1 time: 0.110157 Jun 23 09:31:21.837523 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 450/923] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:21 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:22.850594 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:22.851320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:22.858174 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:22.858621 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:22.859421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:22.859857 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:22.873375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf HTTP/1.1 Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:22.893488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:22.895382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'a07552f3-8f05-43be-9c71-115133c1efbf'} Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:22.896345 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:22.897956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:22.899962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:22.899962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-598b0593-4115-411a-97e5-c3ab750d916e tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 404 len: 111 microversion: 2.1 time: 0.030583 Jun 23 09:31:22.899962 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 474/924] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:22 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:22.900244 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6ee8b483-2fbb-4dec-8c2e-fb44429a1034 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '.version_select at 0x7f82709a81f0>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:23.010497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6ee8b483-2fbb-4dec-8c2e-fb44429a1034 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669381738" status: 202 len: 0 microversion: 2.1 time: 0.128876 Jun 23 09:31:23.011119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 451/925] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669381738 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:31:25.156572 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:25.157068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:25.164202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:25.165196 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:25.166091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:25.166555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:25.184956 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf HTTP/1.1 Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:25.186528 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.188237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'a07552f3-8f05-43be-9c71-115133c1efbf'} Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:25.189195 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.190690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.192312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:25.192312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-07374583-3f82-4431-b407-1fbb11ed4459 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 404 len: 111 microversion: 2.1 time: 0.035309 Jun 23 09:31:25.192312 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 475/926] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:25 2022] DELETE /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:25.197639 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:25.198182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: a07552f3-8f05-43be-9c71-115133c1efbf] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:25.205623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:25.206086 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:25.207173 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:25.207602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:25.221701 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf HTTP/1.1 Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:31:25.223741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.225431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'a07552f3-8f05-43be-9c71-115133c1efbf'} Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:25.226388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. Jun 23 09:31:25.229164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:25.232216 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance a07552f3-8f05-43be-9c71-115133c1efbf could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:25.232216 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a280754c-afc5-44af-84a3-932f2daf46bc tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf" status: 404 len: 111 microversion: 2.1 time: 0.035890 Jun 23 09:31:25.232216 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 452/927] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:25 2022] GET /compute/v2.1/servers/a07552f3-8f05-43be-9c71-115133c1efbf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:31:26.524934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:26.537807 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:26.549365 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.550032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.550821 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.551290 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.570302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 HTTP/1.1 Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:26.572466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.574224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '88e58a13-6ee6-4d01-840f-50a6cc456fb9'} Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:26.575217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.576816 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.578278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:26.578278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4118d3b7-0931-4a22-8737-98d80469cfc2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 404 len: 111 microversion: 2.1 time: 0.054094 Jun 23 09:31:26.578278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 476/928] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:26 2022] DELETE /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:26.585399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:26.587064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: 88e58a13-6ee6-4d01-840f-50a6cc456fb9] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:26.593592 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.594035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.595041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.595643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.612203 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 HTTP/1.1 Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:31:26.614214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.616438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '88e58a13-6ee6-4d01-840f-50a6cc456fb9'} Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:26.617413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. Jun 23 09:31:26.618975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.620651 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance 88e58a13-6ee6-4d01-840f-50a6cc456fb9 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:26.621699 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fd274378-5543-468a-a785-eaaa9c5ca1e2 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9" status: 404 len: 111 microversion: 2.1 time: 0.040546 Jun 23 09:31:26.622426 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 453/929] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:26 2022] GET /compute/v2.1/servers/88e58a13-6ee6-4d01-840f-50a6cc456fb9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:26.636083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:26.636083 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:26.644295 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.644766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.645732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.646172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.667211 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 HTTP/1.1 Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:26.668818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.670486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'da4d3349-a28c-4fb0-8cb5-12cad9123599'} Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:26.671468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.672793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.675289 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:26.676159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-364afec3-77aa-4225-8092-9da9af1d8804 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 404 len: 111 microversion: 2.1 time: 0.048998 Jun 23 09:31:26.676723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 477/930] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:26 2022] DELETE /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:26.684670 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:26.685293 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: da4d3349-a28c-4fb0-8cb5-12cad9123599] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:26.691416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.691888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.692655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:26.693098 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:26.709573 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 HTTP/1.1 Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:31:26.711131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.713493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'da4d3349-a28c-4fb0-8cb5-12cad9123599'} Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:26.714518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. Jun 23 09:31:26.716876 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:26.718339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance da4d3349-a28c-4fb0-8cb5-12cad9123599 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:26.718339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2a848e01-6ee5-4912-b8f3-1f6bb9f2f84f tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599" status: 404 len: 111 microversion: 2.1 time: 0.032263 Jun 23 09:31:26.718339 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 454/931] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:26 2022] GET /compute/v2.1/servers/da4d3349-a28c-4fb0-8cb5-12cad9123599 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:31:28.003970 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:28.009291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:28.028826 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:28.031042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:28.033318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:28.035188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:28.067085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b HTTP/1.1 Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:31:28.070420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.071963 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'f0a229b3-a377-4881-9f1c-769d10ba375b'} Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:28.072769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.074062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.076844 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:28.077081 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-8619c0c1-98ae-4169-9c2d-2fa87ed37872 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 404 len: 111 microversion: 2.1 time: 0.075488 Jun 23 09:31:28.082181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 478/932] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:27 2022] DELETE /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:31:28.089141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:28.089777 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] [instance: f0a229b3-a377-4881-9f1c-769d10ba375b] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:28.101086 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:28.101538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:28.108462 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:28.109600 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] HTTP exception thrown: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Request method failure captured: Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b HTTP/1.1 Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDGP7KuIADzOl85wq3jYfS7I52gW4YLstWDn6hjiD8xbyLHIBj9UjzoGurvJKge54kiV6EfkjUq5kUXKwrzoL9pM10aX71psGAKISqq4tHCYUVGz8gSFTVBzue6_F86fHH-yN9UnOtlcgXWiox8iycI6IqJC8MPdkzkramYQQoNDTmU Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:31:28.139973 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d0795f7c61d497c9b25c7e17ad08744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d0795f7c61d497c9b25c7e17ad08744", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 8d0795f7c61d497c9b25c7e17ad08744 Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-904180418 Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ad5452341ccc40bc94b38369dae4f2b8 Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeNegativeTest-904180418-project Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.141456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'f0a229b3-a377-4881-9f1c-769d10ba375b'} Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:28.142725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. Jun 23 09:31:28.144668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:28.147226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] Returning 404 to user: Instance f0a229b3-a377-4881-9f1c-769d10ba375b could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:28.147226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-67ad270a-2dcf-424c-972d-6089720c85b7 tempest-AttachVolumeNegativeTest-904180418 tempest-AttachVolumeNegativeTest-904180418-project] 10.222.0.52 "GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b" status: 404 len: 111 microversion: 2.1 time: 0.052212 Jun 23 09:31:28.147226 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 455/933] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:28 2022] GET /compute/v2.1/servers/f0a229b3-a377-4881-9f1c-769d10ba375b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:31:38.023140 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:38.067329 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:38.179082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f906bfd9-d330-4a03-aa64-0699ac22ec15 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Action: 'create', calling method: .version_select at 0x7f82709951f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1906002326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsPLUQmC15nfxPVfl/hRskHo7kABkJPQ0sDktPp1PRCS1y5tdiLMCztQCcVkz+jsNphNMQnYz5JqtJ3otdtOiWTQ+dPmQ/CCrPtp7+z6IsvwIsy+T5J8ELIA7IDeoOLzg=="}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:38.194225 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-f906bfd9-d330-4a03-aa64-0699ac22ec15 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for project a100fa3c9d124f9089173a35a1e3691d. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:31:38.199586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-f906bfd9-d330-4a03-aa64-0699ac22ec15 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for user 86a640cdceb34bb9bfbb7b769e797d30 and project a100fa3c9d124f9089173a35a1e3691d. Resources: {'key_pairs'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:31:38.336133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f906bfd9-d330-4a03-aa64-0699ac22ec15 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.331314 Jun 23 09:31:38.336987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 479/934] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:31:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:49.301560 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:49.302092 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:49.304893 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:49.305570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:49.310665 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:49.311146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:49.319049 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:49.319049 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:49.414602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lazy-loading 'services' on Instance uuid 575ce77f-535c-48bb-b311-7c7c515b82df {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:31:49.699881 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-46534843-72e9-475f-8f29-d5ae4beb8ef1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-volume_attachments/3cfeaef0-3ba7-436e-a3b5-a6d6261c99b5" status: 202 len: 0 microversion: 2.1 time: 0.402227 Jun 23 09:31:49.700625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 456/935] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:31:49 2022] DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-volume_attachments/3cfeaef0-3ba7-436e-a3b5-a6d6261c99b5 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:31:51.994365 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:31:51.999384 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d16deca2-60bc-423e-8a2c-99a1419d8508 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:52.008703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d16deca2-60bc-423e-8a2c-99a1419d8508 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:52.009159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d16deca2-60bc-423e-8a2c-99a1419d8508 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:52.032067 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d16deca2-60bc-423e-8a2c-99a1419d8508 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Going to try to stop instance {{(pid=118500) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 09:31:52.344465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d16deca2-60bc-423e-8a2c-99a1419d8508 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action" status: 202 len: 0 microversion: 2.1 time: 0.350609 Jun 23 09:31:52.373472 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 480/936] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:31:51 2022] POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:31:52.380855 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:52.381534 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:52.394297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:52.395117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:52.400843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:52.400843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:52.651077 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:52.658787 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-572b5fad-9552-4f16-b2eb-fd201baedd88 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.282021 Jun 23 09:31:52.659406 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 457/937] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:52 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:53.310527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-9814823c-5fa2-4be1-ba81-6b21e3a1e06b req-a4b2c696-c9a4-4d9c-b206-1f8e64473170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:53.316881 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:53.317469 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:53.319668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-9814823c-5fa2-4be1-ba81-6b21e3a1e06b req-a4b2c696-c9a4-4d9c-b206-1f8e64473170 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.320909 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-9814823c-5fa2-4be1-ba81-6b21e3a1e06b req-a4b2c696-c9a4-4d9c-b206-1f8e64473170 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.338022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.345715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.345715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.346535 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-9814823c-5fa2-4be1-ba81-6b21e3a1e06b req-a4b2c696-c9a4-4d9c-b206-1f8e64473170 service nova] Creating event network-changed:866d3ed7-aceb-4e8d-a61f-b4881b214198 for instance 1c02a829-249f-434a-8551-deca0e564d14 on hv-cinder-84727 Jun 23 09:31:53.346749 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.365225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-9814823c-5fa2-4be1-ba81-6b21e3a1e06b req-a4b2c696-c9a4-4d9c-b206-1f8e64473170 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058035 Jun 23 09:31:53.366838 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 458/938] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:31:53.378535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:31:53.685968 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:53.689460 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:53.716925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.716925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.716925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.716925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.775371 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0c2b53f8-3573-4de4-b4e7-edad16bb913e tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 204 len: 0 microversion: 2.1 time: 0.471223 Jun 23 09:31:53.780216 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 481/939] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:31:53 2022] DELETE /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:31:53.789453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:53.792398 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:53.803265 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.803736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.805152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:53.805592 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:53.953926 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:53.963391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6653b9f2-f7f3-4ae5-8912-ec42f226c785 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.290825 Jun 23 09:31:53.964082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 459/940] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:53 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:31:54.063685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:54.071500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-00538567-9b84-4a5d-80b7-dce3d188b043 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.289483 Jun 23 09:31:54.072360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 482/941] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:53 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:54.980794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:54.981412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:54.988455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:54.988910 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:54.989677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:54.990122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:55.089641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:55.090346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:55.103938 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:55.104390 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:55.105169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:55.105608 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:55.140616 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:55.148147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c9fc9750-42e4-43be-8708-7ef2d02ba7bb tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.171150 Jun 23 09:31:55.160536 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 460/942] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:54 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:55.246813 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:55.254676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-17240ee0-e2f2-4b73-93c5-f24daa1234d0 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1566 microversion: 2.1 time: 0.169250 Jun 23 09:31:55.255278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 483/943] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:55 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:56.167041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:56.173646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:56.182123 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:56.182758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:56.187193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:56.187193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:56.272057 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:56.272670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:56.283733 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:56.284181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:56.284952 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:56.285384 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:56.337309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:56.345532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0aedcefb-1c9f-4364-a01d-4e797755d02e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.183844 Jun 23 09:31:56.346107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 461/944] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:56 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:56.504691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:56.512741 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d7a8fe92-2ae3-4319-a0a7-131c4d84d5fa tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1448 microversion: 2.1 time: 0.244520 Jun 23 09:31:56.517446 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 484/945] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:56 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1448 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:56.803112 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-ef7e9209-97b7-4a82-8022-b25098930054 req-cf3245b6-e883-4bcd-a27d-fb1ee2ef6d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02a829-249f-434a-8551-deca0e564d14", "name": "network-vif-deleted", "tag": "866d3ed7-aceb-4e8d-a61f-b4881b214198"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:56.811872 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-ef7e9209-97b7-4a82-8022-b25098930054 req-cf3245b6-e883-4bcd-a27d-fb1ee2ef6d8d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:56.812432 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-ef7e9209-97b7-4a82-8022-b25098930054 req-cf3245b6-e883-4bcd-a27d-fb1ee2ef6d8d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:56.987201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-ef7e9209-97b7-4a82-8022-b25098930054 req-cf3245b6-e883-4bcd-a27d-fb1ee2ef6d8d service nova] Creating event network-vif-deleted:866d3ed7-aceb-4e8d-a61f-b4881b214198 for instance 1c02a829-249f-434a-8551-deca0e564d14 on hv-cinder-84727 Jun 23 09:31:56.992816 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-ef7e9209-97b7-4a82-8022-b25098930054 req-cf3245b6-e883-4bcd-a27d-fb1ee2ef6d8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193186 Jun 23 09:31:56.993584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 462/946] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:31:57.364433 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:57.365611 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:57.373181 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:57.373635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:57.374430 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:57.374950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:57.530633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:57.539906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:57.540182 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:57.540299 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:57.540399 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:57.541169 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:57.542950 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:57.543234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-eba5396e-0447-46cf-ad9d-85cac111269a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.182610 Jun 23 09:31:57.543234 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 485/947] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:57 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:57.613864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:57.621998 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b34c1b9f-b01b-4987-bf9a-3a18399427f7 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1217 microversion: 2.1 time: 0.095746 Jun 23 09:31:57.622566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 463/948] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:57 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:31:58.560668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:58.561961 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:58.569601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:58.571467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:58.572618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:58.573091 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:58.639715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:58.640319 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:58.646716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:58.647483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:58.648366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:58.648802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:58.684078 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:58.684604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:58.685383 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lazy-loading 'fault' on Instance uuid 1c02a829-249f-434a-8551-deca0e564d14 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:31:58.722242 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:58.726566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65220457c29c46358fee054fb9366406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee3f1c33377446489b75e9faaa5654b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:58.733557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0c0243f5-ff79-4256-9182-bc3c37f30a74 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.175642 Jun 23 09:31:58.733557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 486/949] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:58 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:31:58.734307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2e21a6fb-9db1-4ca8-a54f-48d347b63de2 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 200 len: 1176 microversion: 2.1 time: 0.098444 Jun 23 09:31:58.734864 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 464/950] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:58 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 1176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:31:58.980207 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1311043249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1906002326", "security_groups": [{"name": "tempest-secgroup-smoke-1018351472"}], "block_device_mapping_v2": [{"uuid": "d3856698-a0aa-4822-95ac-4101be415468", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "88fe912b-da29-4c17-ab52-b1ab29cc85c5"}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:31:59.090513 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] validate_networks() for [('88fe912b-da29-4c17-ab52-b1ab29cc85c5', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:31:59.491011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:31:59.491634 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:31:59.492643 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:31:59.493248 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:31:59.493837 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:31:59.503921 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:59.504679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:59.505159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:59.505595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:59.523825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for project a100fa3c9d124f9089173a35a1e3691d. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:31:59.528122 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for user 86a640cdceb34bb9bfbb7b769e797d30 and project a100fa3c9d124f9089173a35a1e3691d. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:31:59.748501 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:59.749113 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:59.755954 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:59.756420 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:59.757170 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:59.758110 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:59.771720 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:31:59.774480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3856698-a0aa-4822-95ac-4101be415468',volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:31:59.896051 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:31:59.903703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e8c8878f-6514-4bc1-92a6-573bf38252b8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.159173 Jun 23 09:31:59.904268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 465/951] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:59 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:31:59.908626 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:31:59.909220 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] [instance: 1c02a829-249f-434a-8551-deca0e564d14] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:31:59.915470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:59.915930 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:59.916693 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:31:59.917138 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:31:59.930890 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] HTTP exception thrown: Instance 1c02a829-249f-434a-8551-deca0e564d14 could not be found. Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Request method failure captured: Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 HTTP/1.1 Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDHUFIGulhk4kBqtYbDycbcA989cQZkpsYDP1xyBAeJMGeMMuf-utp487w5zFhRmCsTwnpLu7nwQ2k9XI4BqiEP-Gj9h2qk1nomv8FFJZbgj8AOOU-uwByPliax381BVHx-XuOvuXjx4H4KFWMgUFmfcMaXDsB50xu13AuptHMdVpb8 Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 3ee3f1c33377446489b75e9faaa5654b Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-TestShelveInstance-1814145903 Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:31:59.932636 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3ee3f1c33377446489b75e9faaa5654b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3ee3f1c33377446489b75e9faaa5654b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3ee3f1c33377446489b75e9faaa5654b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3ee3f1c33377446489b75e9faaa5654b", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-TestShelveInstance-1814145903 Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 3ee3f1c33377446489b75e9faaa5654b Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-TestShelveInstance-1814145903 Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-TestShelveInstance-1814145903-project Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 65220457c29c46358fee054fb9366406 Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-TestShelveInstance-1814145903-project Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 1c02a829-249f-434a-8551-deca0e564d14 could not be found. Jun 23 09:31:59.934443 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '1c02a829-249f-434a-8551-deca0e564d14'} Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c02a829-249f-434a-8551-deca0e564d14 could not be found. Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:31:59.935509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c02a829-249f-434a-8551-deca0e564d14 could not be found. Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c02a829-249f-434a-8551-deca0e564d14 could not be found. Jun 23 09:31:59.937168 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:31:59.938672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Returning 404 to user: Instance 1c02a829-249f-434a-8551-deca0e564d14 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:31:59.938672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a16b7ee9-4691-4a29-9c49-149787626698 tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14" status: 404 len: 111 microversion: 2.1 time: 0.028853 Jun 23 09:31:59.938672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 466/952] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:31:59 2022] GET /compute/v2.1/servers/1c02a829-249f-434a-8551-deca0e564d14 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:32:00.213483 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b21db932-8ede-49ab-85a9-3b1aea32569c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] Calling method '.version_select at 0x7f827093da60>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:00.358725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b21db932-8ede-49ab-85a9-3b1aea32569c tempest-TestShelveInstance-1814145903 tempest-TestShelveInstance-1814145903-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476245517" status: 202 len: 0 microversion: 2.1 time: 0.149020 Jun 23 09:32:00.359329 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 467/953] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jun 23 09:32:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476245517 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:32:00.900089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-da1794e9-2314-4513-ba5a-ddaf0ff84ca7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.924163 Jun 23 09:32:00.906274 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 487/954] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:31:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:32:00.911248 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-941d837e-3293-4b0b-a87c-5ac544a86492 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:00.911794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-941d837e-3293-4b0b-a87c-5ac544a86492 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:00.923196 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:00.924286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:00.931129 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:00.931867 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:00.934307 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:00.935179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:00.999740 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-941d837e-3293-4b0b-a87c-5ac544a86492 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:01.009962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-941d837e-3293-4b0b-a87c-5ac544a86492 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1095 microversion: 2.1 time: 0.102418 Jun 23 09:32:01.010966 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 468/955] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:00 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:32:01.424701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:01.433028 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-18f2a123-aa2f-406d-bf08-842e606267ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.515939 Jun 23 09:32:01.433637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 488/956] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:00 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:32:02.029902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-951f8b29-045e-4404-a2c7-7ca8dc082877 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:02.030794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-951f8b29-045e-4404-a2c7-7ca8dc082877 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:02.128114 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-951f8b29-045e-4404-a2c7-7ca8dc082877 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:02.151085 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-951f8b29-045e-4404-a2c7-7ca8dc082877 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1095 microversion: 2.1 time: 0.113631 Jun 23 09:32:02.151085 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 469/957] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:02 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1095 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:02.451670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:02.453062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:02.459955 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:02.460973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:02.462094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:02.462535 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:02.713094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:02.727581 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4ff9fb19-9ecd-450d-9a74-f3fcad3ff049 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1676 microversion: 2.1 time: 0.279869 Jun 23 09:32:02.728176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 489/958] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:02 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:03.161083 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:03.161694 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:03.169124 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:03.169573 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:03.171622 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:03.171622 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:03.240490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:03.249104 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-10d4dc12-4d40-4d60-a0bb-41a7c21b6661 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1193 microversion: 2.1 time: 0.091964 Jun 23 09:32:03.250474 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 470/959] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:03 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:03.746346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:03.746997 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:03.779311 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:03.779775 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:03.789273 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:03.789273 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:04.071980 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:04.079514 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b7b6b079-a04f-438a-ba60-ccd437a4be6a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1653 microversion: 2.1 time: 0.338953 Jun 23 09:32:04.080086 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 490/960] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:03 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1653 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:04.108319 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-59453f35-0562-45ba-9812-e67341753cb5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:04.116247 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-59453f35-0562-45ba-9812-e67341753cb5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:04.116725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-59453f35-0562-45ba-9812-e67341753cb5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:04.232844 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-59453f35-0562-45ba-9812-e67341753cb5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Going to try to start instance {{(pid=118501) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 09:32:04.269372 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:04.273012 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:04.285692 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:04.286378 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:04.287356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:04.287965 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:04.380270 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:04.394253 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-30d4d37c-284c-48e6-a46b-58009789f1ce tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1201 microversion: 2.1 time: 0.128442 Jun 23 09:32:04.399111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 491/961] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:04 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1201 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:04.611105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-59453f35-0562-45ba-9812-e67341753cb5 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action" status: 202 len: 0 microversion: 2.1 time: 0.501759 Jun 23 09:32:04.611105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 471/962] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jun 23 09:32:04 2022] POST /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:32:04.619024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:04.619641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:04.627678 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:04.628134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:04.639861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:04.639861 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:04.887856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:04.900989 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-69ae3008-3a54-4c93-8753-219f0082adb7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1662 microversion: 2.1 time: 0.285903 Jun 23 09:32:04.900989 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 492/963] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:04 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1662 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:32:05.412975 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:05.413692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:05.420345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:05.420803 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:05.421586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:05.422032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:05.618755 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:05.627252 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bf150a1c-fef0-45d3-97c9-a2682f18ac08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1279 microversion: 2.1 time: 0.219105 Jun 23 09:32:05.627838 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 472/964] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:05 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1279 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:05.923056 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:05.923883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:05.942769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:05.943449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:05.944413 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:05.946126 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:06.346077 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:06.354170 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-44915216-f7e0-45f6-865d-cd644a5f30e2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1662 microversion: 2.1 time: 0.438122 Jun 23 09:32:06.354742 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 493/965] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:05 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1662 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:06.652826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:06.654196 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:06.664337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:06.664785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:06.665558 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:06.665995 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:06.802566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:06.811043 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-88e178f8-0176-4429-86ba-b007f8a232af tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.163665 Jun 23 09:32:06.811774 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 473/966] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:06 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:07.373177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:07.373801 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:07.380271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:07.380715 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:07.381475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:07.381910 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:07.401330 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:07.828163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:07.829049 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:07.836874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:07.837322 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:07.838779 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:07.839410 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:07.850305 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:07.873833 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-75696022-9ad5-4f44-8232-eef078b45612 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1666 microversion: 2.1 time: 0.503525 Jun 23 09:32:07.874497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 494/967] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:07 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1666 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:07.937525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-7753b0c8-11da-4576-958b-068e65a49842 req-12cc53c5-5923-44f0-a7eb-3105a349565d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147", "tag": "08844799-4090-4da0-968c-37240d55bee9"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:07.983707 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-7753b0c8-11da-4576-958b-068e65a49842 req-12cc53c5-5923-44f0-a7eb-3105a349565d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:07.984626 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-7753b0c8-11da-4576-958b-068e65a49842 req-12cc53c5-5923-44f0-a7eb-3105a349565d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:08.008259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-7753b0c8-11da-4576-958b-068e65a49842 req-12cc53c5-5923-44f0-a7eb-3105a349565d service nova] Creating event network-changed:08844799-4090-4da0-968c-37240d55bee9 for instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 on hv-cinder-84727 Jun 23 09:32:08.024784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-7753b0c8-11da-4576-958b-068e65a49842 req-12cc53c5-5923-44f0-a7eb-3105a349565d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093508 Jun 23 09:32:08.025701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 495/968] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:32:08.101961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:08.111166 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-8feb9b19-45fb-45f0-bd42-d1cfa759966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.285820 Jun 23 09:32:08.111836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 474/969] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:07 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:09.131092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:09.131943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:09.149571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:09.150458 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:09.151443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:09.152051 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:09.348129 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:09.356912 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-37696472-57c8-4697-817c-8d55d3752095 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.231543 Jun 23 09:32:09.358747 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 496/970] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:09 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:10.374441 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:10.378888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:10.381650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:10.382117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:10.382965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:10.383501 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:10.402523 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:10.524554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:10.532364 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e0377c70-3568-41f5-822e-1c849b24e936 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.161957 Jun 23 09:32:10.533243 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 475/971] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:10 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:11.549664 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:11.551106 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:11.554748 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:11.555434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:11.560243 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:11.561042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:11.561990 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:11.562425 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:11.704298 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:11.711730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c2558d2e-3731-4c66-b202-b697af7571f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.166133 Jun 23 09:32:11.712287 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 497/972] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:11 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:12.728994 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:12.730362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:12.734549 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=4 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:12.740249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:12.740924 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:12.741936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:12.742381 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:12.878467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:12.886024 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-146c6d79-fc47-41cf-8c1b-42edec70f7ad tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.161376 Jun 23 09:32:12.895398 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 476/973] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:12 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:13.903427 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:13.904048 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:13.911488 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:13.911987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:13.912711 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:13.913150 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:14.130190 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:14.143896 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f3dd0cfd-e151-4799-bb47-424c32e5da08 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.244166 Jun 23 09:32:14.144947 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 498/974] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:13 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:15.174279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:15.175662 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:15.184273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:15.184721 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:15.185489 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:15.185920 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:15.355365 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:15.368538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d85fb2c1-1056-4914-b4e0-053ed3e8e58c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.201998 Jun 23 09:32:15.369252 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 477/975] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:15 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:16.385202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:16.386153 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:16.393654 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:16.394188 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:16.395071 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:16.395584 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:16.532417 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:16.540071 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-da37d799-26a2-41dc-9bd5-efa3bc49c809 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.158885 Jun 23 09:32:16.549887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 499/976] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:16 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:16.902139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-110212952", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "networks": [{"uuid": "0c5dae6b-c436-4b72-8060-f13fcb71482a"}]}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:16.956181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] validate_networks() for [('0c5dae6b-c436-4b72-8060-f13fcb71482a', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:32:17.318092 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:32:17.318522 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:32:17.319032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:32:17.319450 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:32:17.320492 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:32:17.330380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:17.330836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:17.331776 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:17.332158 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:17.348845 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Getting quotas for project e06cabc6fd104c7cbd2758700a0d29a8. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:32:17.353059 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Getting quotas for user ee3ad4a33625438fb5c0ae12314689d6 and project e06cabc6fd104c7cbd2758700a0d29a8. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:32:17.370836 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:32:17.373160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:32:17.502072 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d2015924-287e-4c14-abff-0739c59d5132 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603745 Jun 23 09:32:17.502707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 478/977] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:32:17.513095 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-59fc2f57-97df-4bda-9fcb-cd9e51b033cb tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:17.513834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-59fc2f57-97df-4bda-9fcb-cd9e51b033cb tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:17.563415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:17.564106 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:17.569323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-59fc2f57-97df-4bda-9fcb-cd9e51b033cb tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:17.574714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:17.575577 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:17.576957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:17.578052 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:17.578882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-59fc2f57-97df-4bda-9fcb-cd9e51b033cb tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1218 microversion: 2.1 time: 0.069645 Jun 23 09:32:17.580011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 500/978] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:17 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:17.785037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:17.793197 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d3b60a69-0e62-4c33-95d5-eb0771fa02a3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.235879 Jun 23 09:32:17.797183 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 479/979] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:17 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:18.237382 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-13a21715-6f79-48af-aee2-c0355ca50a41 req-5b5ebcea-e354-462f-b513-779390d64617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147", "name": "network-vif-plugged", "status": "completed", "tag": "08844799-4090-4da0-968c-37240d55bee9"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:18.248665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-13a21715-6f79-48af-aee2-c0355ca50a41 req-5b5ebcea-e354-462f-b513-779390d64617 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:18.249112 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-13a21715-6f79-48af-aee2-c0355ca50a41 req-5b5ebcea-e354-462f-b513-779390d64617 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:18.259565 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-13a21715-6f79-48af-aee2-c0355ca50a41 req-5b5ebcea-e354-462f-b513-779390d64617 service nova] Creating event network-vif-plugged:08844799-4090-4da0-968c-37240d55bee9 for instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 on hv-cinder-84727 Jun 23 09:32:18.264900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-13a21715-6f79-48af-aee2-c0355ca50a41 req-5b5ebcea-e354-462f-b513-779390d64617 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031762 Jun 23 09:32:18.265493 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 501/980] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:32:18.596570 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d2f29758-e0a5-4974-8721-8098c37c6d7f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:18.597434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d2f29758-e0a5-4974-8721-8098c37c6d7f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:18.650838 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d2f29758-e0a5-4974-8721-8098c37c6d7f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:18.657867 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d2f29758-e0a5-4974-8721-8098c37c6d7f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1218 microversion: 2.1 time: 0.065712 Jun 23 09:32:18.664718 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 480/981] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:18 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:18.810972 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:18.811662 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:18.817930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:18.818378 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:18.819190 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:18.820256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:18.950898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:18.958340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-40012e27-2a28-4875-809e-76ff5e1c0cdc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.152045 Jun 23 09:32:18.958903 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 502/982] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:18 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:19.676880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:19.677527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:19.687402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:19.687855 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:19.688625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:19.689076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:19.751745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:19.759791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-997e3d2d-374d-490f-a13b-b6cede6fe640 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1214 microversion: 2.1 time: 0.088550 Jun 23 09:32:19.760370 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 481/983] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:19 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:19.975059 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:19.975688 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:19.986767 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:19.987261 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:19.988017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:19.988703 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:20.136755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:20.144277 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-126dd802-e75c-4c93-99f5-023c7050fe40 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1267 microversion: 2.1 time: 0.173168 Jun 23 09:32:20.144932 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 503/984] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:19 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:20.777133 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:20.777785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:20.784027 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:20.784472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:20.785279 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:20.785750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:20.854939 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:20.862599 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-dea8bf16-04ee-4ff2-85cc-b979d6726e3e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1270 microversion: 2.1 time: 0.090019 Jun 23 09:32:20.863195 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 482/985] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:20 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:21.161172 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:21.161785 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:21.168296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:21.168869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:21.169674 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:21.170111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:21.633278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:21.643538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-18217e1f-d971-49f8-afab-d21e7e8be419 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1455 microversion: 2.1 time: 0.483785 Jun 23 09:32:21.645827 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 504/986] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:21 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1455 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:21.657016 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:21.657635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:21.664153 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:21.664599 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:21.665367 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:21.665803 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:21.809730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:21.816829 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7dc29150-c4cd-4b31-8af4-6d4c48572551 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1455 microversion: 2.1 time: 0.163702 Jun 23 09:32:21.817571 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 483/987] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:21 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:21.878887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:21.879613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:21.885905 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:21.886353 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:21.887885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:21.888318 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:21.980298 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:21.988885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4c54a4e9-0ebd-454f-8f5c-7f853dacdc75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1288 microversion: 2.1 time: 0.113637 Jun 23 09:32:22.002006 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 505/988] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:21 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:23.010333 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:23.011085 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:23.017333 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:23.017786 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:23.018552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:23.019028 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:23.161215 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:23.170487 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a485c0f5-bfe6-47e8-b637-56e097627080 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.164610 Jun 23 09:32:23.174894 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 484/989] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:23 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:24.188423 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:24.189033 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:24.191545 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:24.196260 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:24.196710 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:24.197482 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:24.197917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:24.395892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:24.405847 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-edbdc964-1045-4197-9e2e-635963e92cd3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.221346 Jun 23 09:32:24.406415 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 506/990] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:24 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:24.468307 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-f4a1d3c8-419e-4316-adef-169b2ed6d507 req-9c35fb60-e1a4-4887-876d-bc16d7307be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c310931-4054-48c8-84e3-3001196466a7", "tag": "d8d8d6b6-e75a-4f00-bb0a-65014005b289"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:24.481204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-f4a1d3c8-419e-4316-adef-169b2ed6d507 req-9c35fb60-e1a4-4887-876d-bc16d7307be3 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:24.481730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-f4a1d3c8-419e-4316-adef-169b2ed6d507 req-9c35fb60-e1a4-4887-876d-bc16d7307be3 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:24.493776 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-f4a1d3c8-419e-4316-adef-169b2ed6d507 req-9c35fb60-e1a4-4887-876d-bc16d7307be3 service nova] Creating event network-changed:d8d8d6b6-e75a-4f00-bb0a-65014005b289 for instance 4c310931-4054-48c8-84e3-3001196466a7 on hv-cinder-84727 Jun 23 09:32:24.499565 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-f4a1d3c8-419e-4316-adef-169b2ed6d507 req-9c35fb60-e1a4-4887-876d-bc16d7307be3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034999 Jun 23 09:32:24.501925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 485/991] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:32:25.423436 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:25.425349 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:25.431837 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:25.433346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:25.433346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:25.433790 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:25.677995 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:25.686825 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e28b433e-1ca6-4582-9e8a-e4df259d8d38 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.267636 Jun 23 09:32:25.690093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 507/992] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:25 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:26.544038 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-31a36416-b878-4a12-8b43-cb73ce7add3c req-0c9868f1-5f71-4790-9b11-bb372b080045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147", "tag": "08844799-4090-4da0-968c-37240d55bee9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:26.548201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:26.553531 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-31a36416-b878-4a12-8b43-cb73ce7add3c req-0c9868f1-5f71-4790-9b11-bb372b080045 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:26.554555 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-31a36416-b878-4a12-8b43-cb73ce7add3c req-0c9868f1-5f71-4790-9b11-bb372b080045 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:26.565127 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-31a36416-b878-4a12-8b43-cb73ce7add3c req-0c9868f1-5f71-4790-9b11-bb372b080045 service nova] Creating event network-changed:08844799-4090-4da0-968c-37240d55bee9 for instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 on hv-cinder-84727 Jun 23 09:32:26.572026 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-31a36416-b878-4a12-8b43-cb73ce7add3c req-0c9868f1-5f71-4790-9b11-bb372b080045 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031490 Jun 23 09:32:26.572511 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 486/993] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:32:26.706645 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:26.707237 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:26.713840 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:26.714375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:26.715169 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:26.715606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:26.856458 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:26.864924 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-874afbee-4d09-4f0b-8970-a9c910e91b80 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.162343 Jun 23 09:32:26.865504 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 508/994] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:26 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:27.878873 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:27.884258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:27.885082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:27.891957 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:27.895932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:27.895932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:27.895932 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:28.030995 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:28.038645 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d97446db-4d6c-401a-bf49-b1240b5273f2 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.160688 Jun 23 09:32:28.039245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 487/995] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:27 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:29.055191 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:29.056230 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:29.057691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:29.064500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:29.065304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:29.066721 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:29.067555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:29.206579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:29.214736 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c43efb13-8635-4f13-b255-e8d712c84aa5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.163851 Jun 23 09:32:29.221590 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 509/996] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:29 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:30.145676 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-98b45ad2-1e93-4b10-87c6-3b6a8803df06 req-d014f429-f9a4-4dee-9fd8-4a00deca43f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c310931-4054-48c8-84e3-3001196466a7", "name": "network-vif-plugged", "status": "completed", "tag": "d8d8d6b6-e75a-4f00-bb0a-65014005b289"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:30.149533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=8 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:30.156642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-98b45ad2-1e93-4b10-87c6-3b6a8803df06 req-d014f429-f9a4-4dee-9fd8-4a00deca43f7 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:30.157090 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-98b45ad2-1e93-4b10-87c6-3b6a8803df06 req-d014f429-f9a4-4dee-9fd8-4a00deca43f7 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:30.168471 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-98b45ad2-1e93-4b10-87c6-3b6a8803df06 req-d014f429-f9a4-4dee-9fd8-4a00deca43f7 service nova] Creating event network-vif-plugged:d8d8d6b6-e75a-4f00-bb0a-65014005b289 for instance 4c310931-4054-48c8-84e3-3001196466a7 on hv-cinder-84727 Jun 23 09:32:30.173467 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-98b45ad2-1e93-4b10-87c6-3b6a8803df06 req-d014f429-f9a4-4dee-9fd8-4a00deca43f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Jun 23 09:32:30.174060 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 488/997] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:32:30.234002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:30.234862 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:30.243104 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:30.243554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:30.244366 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:30.244809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:30.381478 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:30.388935 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-b1bd678c-fc3e-4948-bbbf-6e3cee1ae441 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.159251 Jun 23 09:32:30.389494 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 510/998] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:30 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:31.407273 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:31.407901 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:31.414647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:31.415134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:31.415899 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:31.416337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:31.544039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:31.551767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5bbaf09b-f618-4546-a188-9a7914813990 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1318 microversion: 2.1 time: 0.149595 Jun 23 09:32:31.552495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 489/999] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:31 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:32.569635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:32.570252 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:32.577036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:32.577480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:32.578379 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:32.578822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:32.713743 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:32.721196 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3f5b9a0e-ebab-4540-a795-f625eb08e062 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1507 microversion: 2.1 time: 0.155823 Jun 23 09:32:32.729381 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 511/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:32 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:52.197206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:52.198134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:52.200674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=7 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:52.205615 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=64 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:52.206300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:52.206756 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:52.207567 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:52.208008 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:52.237087 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b7047bfe-db9e-4bd9-93ad-691ea76019b6 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044552 Jun 23 09:32:52.237655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 490/1001] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:32:52 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:32:52.297263 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:52.297836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:52.300276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=11 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:52.300964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=90 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:32:52.306212 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:52.306660 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:52.307449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:52.307881 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:52.332480 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:32:52.637254 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-aac9aa38-ea92-4b98-b244-2e47370d7246 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 204 len: 0 microversion: 2.1 time: 0.343779 Jun 23 09:32:52.637898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 512/1002] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:32:52 2022] DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:32:52.646490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:52.647128 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:52.654791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:52.655263 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:52.656015 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:52.656446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:52.786613 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:52.794599 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-3ccf3570-e482-43d4-bc88-fd9d7d24eed4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1672 microversion: 2.1 time: 0.152217 Jun 23 09:32:52.799612 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 491/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:52 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:53.812484 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:53.813185 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:53.819949 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:53.820397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:53.821156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:53.821588 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:53.953173 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:53.960716 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-33ac273b-a466-4f91-ac84-296d235b890b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1672 microversion: 2.1 time: 0.152556 Jun 23 09:32:53.961798 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 513/1004] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:53 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:32:54.977915 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:54.978562 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:54.985009 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:54.985454 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:54.986208 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:54.986642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:55.117713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:55.125741 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-5d02d1d3-0244-40b6-8f59-7f5e67d5faba tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1672 microversion: 2.1 time: 0.151802 Jun 23 09:32:55.126343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 492/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:54 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:55.544513 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1fd6aac-c37d-4165-af0d-54ccac72b793", "device": "/dev/sdb"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:55.546178 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:55.552797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:55.556765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:55.556765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:55.556765 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:56.067668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-00465ffc-2966-4cf0-8f5c-7890345e22ef req-5d528ab0-f9e8-4672-a16a-d6ee9d8d1b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575ce77f-535c-48bb-b311-7c7c515b82df", "name": "network-vif-deleted", "tag": "95dc3d13-1af1-41f6-949f-2220f4476942"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:56.076845 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-00465ffc-2966-4cf0-8f5c-7890345e22ef req-5d528ab0-f9e8-4672-a16a-d6ee9d8d1b92 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:56.077925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-00465ffc-2966-4cf0-8f5c-7890345e22ef req-5d528ab0-f9e8-4672-a16a-d6ee9d8d1b92 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:56.089916 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-00465ffc-2966-4cf0-8f5c-7890345e22ef req-5d528ab0-f9e8-4672-a16a-d6ee9d8d1b92 service nova] Creating event network-vif-deleted:95dc3d13-1af1-41f6-949f-2220f4476942 for instance 575ce77f-535c-48bb-b311-7c7c515b82df on hv-cinder-84727 Jun 23 09:32:56.095032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-00465ffc-2966-4cf0-8f5c-7890345e22ef req-5d528ab0-f9e8-4672-a16a-d6ee9d8d1b92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 Jun 23 09:32:56.095820 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 493/1006] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:32:56.145245 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:56.146695 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:56.155758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:56.156214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:56.157230 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:56.157434 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:56.260704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:32:56.268902 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a9e74c16-da6a-49cb-9c94-5aa14a6fc8d3 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 200 len: 1606 microversion: 2.1 time: 0.128686 Jun 23 09:32:56.270960 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 494/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:56 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 1606 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:32:56.436570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6f6e8b46-9476-4cec-a116-7a86bb4cb02a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "POST /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896658 Jun 23 09:32:56.442119 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 514/1008] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:32:55 2022] POST /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:32:57.286965 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:57.287545 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:32:57.293495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:57.293945 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:57.294705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:32:57.295181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:32:57.310825 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] HTTP exception thrown: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Request method failure captured: Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df HTTP/1.1 Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDJ6wnBjQY-eLI121_ArkHD5MXYkstxb7R3QVrXYE8aW-2cOHliX4rXqbBvcVKLWOXscWfB2oJp3bec26Ebz5hNoyLLYdRKzmhPAxcLKjNtxKf_KvGMKcuIB_qpg6Gj-f5CGJjrXRnGwa-2K2VjI7IGY4RlYi9YFpLH5rIMruzR5E2k Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:32:57.312723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19a424690e5b44d58c27c5f872c38bd4", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 9f0d4416e74a4126a6aa1ccf58e22ee3 Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:32:57.314553 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '575ce77f-535c-48bb-b311-7c7c515b82df'} Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:32:57.315863 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:32:57.317691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:32:57.319424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Returning 404 to user: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:32:57.319424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-db504118-62a0-4c6e-bdce-8c4809e5768b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 404 len: 111 microversion: 2.1 time: 0.031330 Jun 23 09:32:57.319424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 495/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:32:57 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:32:57.324876 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-12e0a4b0-d63a-414f-b3f7-0e4358142654 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '.version_select at 0x7f8270b244c0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:32:57.427256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-12e0a4b0-d63a-414f-b3f7-0e4358142654 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111862993" status: 202 len: 0 microversion: 2.1 time: 0.107191 Jun 23 09:32:57.441850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 515/1010] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111862993 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:32:58.234647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c8344939-f928-4f74-8f28-5f879b7684cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: .version_select at 0x7f8270b0e940>, body: {"keypair": {"name": "tempest-keypair-1896427009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3EQn+wcel3Om8a9zvix8OUMjykjAMYOVBab4Ia3574dZLf9cVYPy5IF/ldrO/fQZ+olDFB2GydXsBh3KlcqmA+w1a4OIOQ8GDdy0PQBjVjI/UKR5/sxkDJLZ6VXHXGnQ=="}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:32:58.249003 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-c8344939-f928-4f74-8f28-5f879b7684cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:32:58.252758 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-c8344939-f928-4f74-8f28-5f879b7684cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for user 9f0d4416e74a4126a6aa1ccf58e22ee3 and project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'key_pairs'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:32:58.392906 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c8344939-f928-4f74-8f28-5f879b7684cc tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161983 Jun 23 09:32:58.393566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 496/1011] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jun 23 09:32:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:00.834864 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-262304868", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91dc23ae-594e-42cc-bac4-fbd112cab953"}], "security_groups": [{"name": "tempest-securitygroup--50303530"}], "key_name": "tempest-keypair-1896427009", "user_data": "}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:00.937884 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] validate_networks() for [('91dc23ae-594e-42cc-bac4-fbd112cab953', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:33:01.297902 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:33:01.298320 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:33:01.298784 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:33:01.299232 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:33:01.299637 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:33:01.308524 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:01.310428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:01.310428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:01.310428 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:01.327598 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:33:01.331632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Getting quotas for user 9f0d4416e74a4126a6aa1ccf58e22ee3 and project 19a424690e5b44d58c27c5f872c38bd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:33:01.343226 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:33:01.345548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:33:01.483892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4b897433-7d88-462b-96d7-c89aca270c35 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.655107 Jun 23 09:33:01.484555 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 516/1012] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:33:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:33:01.495705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-16906175-884c-4aaa-8004-c657a67dcafe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:01.496315 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-16906175-884c-4aaa-8004-c657a67dcafe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:01.551661 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-16906175-884c-4aaa-8004-c657a67dcafe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:01.559005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-16906175-884c-4aaa-8004-c657a67dcafe tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1237 microversion: 2.1 time: 0.068169 Jun 23 09:33:01.559658 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 497/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:01 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:02.576404 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:02.577003 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:02.584082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:02.584537 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:02.585300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:02.585741 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:02.646829 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:02.654864 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d5e3566c-4c1f-4b94-ba13-084eac7788ea tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1241 microversion: 2.1 time: 0.082917 Jun 23 09:33:02.655413 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 517/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:02 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:03.671745 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:03.672359 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:03.678936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:03.679412 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:03.680681 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:03.681124 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:03.743005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:03.751251 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e082656e-7210-4a45-8213-4ff194af9c1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1289 microversion: 2.1 time: 0.083367 Jun 23 09:33:03.751822 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 498/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:03 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:04.768900 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:04.769448 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:04.775823 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:04.776266 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:04.777017 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:04.777453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:04.841039 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:04.848964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c6beaf20-e1b0-4206-9ecf-7c0807ece28a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1295 microversion: 2.1 time: 0.083946 Jun 23 09:33:04.849551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 518/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:04 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:05.867457 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:05.868117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:05.874850 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:05.875341 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:05.876111 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:05.876550 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:06.005585 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:06.018352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a1bbedff-44a9-496e-ac2b-099b72c55d84 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.152776 Jun 23 09:33:06.018352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 499/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:05 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:06.340418 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-f1b3ffd2-d4d3-4c7b-a111-539c87091403 req-dbdf843a-791d-4517-8fe8-6d2d63972b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1a0af6-1f53-4677-a3a0-4bac58197c29", "tag": "4e4ee781-df17-48a8-b586-45bc48fd55f1"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:06.350496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-f1b3ffd2-d4d3-4c7b-a111-539c87091403 req-dbdf843a-791d-4517-8fe8-6d2d63972b58 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:06.351125 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-f1b3ffd2-d4d3-4c7b-a111-539c87091403 req-dbdf843a-791d-4517-8fe8-6d2d63972b58 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:06.365532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-f1b3ffd2-d4d3-4c7b-a111-539c87091403 req-dbdf843a-791d-4517-8fe8-6d2d63972b58 service nova] Creating event network-changed:4e4ee781-df17-48a8-b586-45bc48fd55f1 for instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 on hv-cinder-84727 Jun 23 09:33:06.371622 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-f1b3ffd2-d4d3-4c7b-a111-539c87091403 req-dbdf843a-791d-4517-8fe8-6d2d63972b58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035003 Jun 23 09:33:06.372245 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 519/1018] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:07.033396 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:07.033937 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:07.041214 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:07.041664 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:07.042424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:07.042858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:07.169916 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:07.177415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-504b24aa-5101-40db-8f4b-add4fc925b3a tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.148065 Jun 23 09:33:07.178446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 500/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:07 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:08.194538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:08.195852 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:08.202542 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:08.203029 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:08.203797 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:08.204265 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:08.338177 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:08.345655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fdb67f70-2869-41ef-b114-d7c839a869a1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.155344 Jun 23 09:33:08.346220 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 520/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:08 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:09.363173 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:09.363784 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:09.370458 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:09.370899 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:09.371687 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:09.372119 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:09.503675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:09.511775 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c0005c29-f731-42d6-9101-640eb8cdcd79 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.152472 Jun 23 09:33:09.512347 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 501/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:09 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:10.529793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:10.530364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:10.536879 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:10.542217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:10.542217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:10.542217 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:10.664466 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:10.671996 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-52019073-3122-4853-a116-e13bdffefc53 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.146236 Jun 23 09:33:10.672556 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 521/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:10 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:11.688415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:11.689019 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:11.691411 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=6 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:11.696163 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:11.696604 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:11.697360 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:11.697784 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:11.826961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:11.834301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-159f196a-59af-4125-a4e5-833e64d4c957 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.149799 Jun 23 09:33:11.834859 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 502/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:11 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:12.851185 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:12.852420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:12.854357 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:12.855029 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:12.860267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:12.860716 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:12.861467 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:12.861899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:12.997407 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:13.004808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-67fbe3ed-38a2-4545-94fe-20e94c0cfe9e tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.157559 Jun 23 09:33:13.005373 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 522/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:12 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:14.021807 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:14.022418 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:14.029336 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:14.029777 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:14.030526 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:14.030982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:14.165014 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:14.170486 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ffe262b4-a1e5-41d6-b98a-d95f0cb8d690 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.152679 Jun 23 09:33:14.171086 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 503/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:14 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:14.839408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-9781cd58-952a-406e-8157-04b5fe7e52a7 req-6fcc4ea3-51ed-4a47-a218-7a5d4e1d1e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1a0af6-1f53-4677-a3a0-4bac58197c29", "name": "network-vif-plugged", "status": "completed", "tag": "4e4ee781-df17-48a8-b586-45bc48fd55f1"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:14.848299 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-9781cd58-952a-406e-8157-04b5fe7e52a7 req-6fcc4ea3-51ed-4a47-a218-7a5d4e1d1e6b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:14.849969 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-9781cd58-952a-406e-8157-04b5fe7e52a7 req-6fcc4ea3-51ed-4a47-a218-7a5d4e1d1e6b service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:14.859954 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-9781cd58-952a-406e-8157-04b5fe7e52a7 req-6fcc4ea3-51ed-4a47-a218-7a5d4e1d1e6b service nova] Creating event network-vif-plugged:4e4ee781-df17-48a8-b586-45bc48fd55f1 for instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 on hv-cinder-84727 Jun 23 09:33:14.865137 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-9781cd58-952a-406e-8157-04b5fe7e52a7 req-6fcc4ea3-51ed-4a47-a218-7a5d4e1d1e6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Jun 23 09:33:14.865718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 523/1026] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:15.189248 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:15.189858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:15.196803 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:15.197249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:15.198100 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:15.198964 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:15.350180 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:15.358175 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c4621424-314b-496e-8839-d0d60eb5d370 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.174022 Jun 23 09:33:15.358744 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 504/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:15 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:16.376517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:16.377212 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:16.383453 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:16.383898 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:16.384660 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:16.385093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:16.512740 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:16.520210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-02f97166-9cba-4a16-aab8-16bba984d141 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.148381 Jun 23 09:33:16.520774 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 524/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:16 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:17.537584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:17.538141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:17.545190 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:17.545647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:17.546403 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:17.546842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:17.676593 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:17.684035 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0f33df82-6f28-47b0-b1d6-05f8ab678596 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.150458 Jun 23 09:33:17.687600 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 505/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:17 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:18.701447 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:18.702101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:18.708648 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:18.709109 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:18.709874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:18.710313 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:18.847082 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:18.854872 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ad7fda78-b9a9-490f-9b8a-cf1364360f1c tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1361 microversion: 2.1 time: 0.157422 Jun 23 09:33:18.855468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 525/1030] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:18 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:19.872222 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:19.872834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:19.879308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:19.879753 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:19.880510 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:19.880940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:20.007380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:20.014865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-6e174dae-25c3-4077-9615-00fe5e8b5724 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1546 microversion: 2.1 time: 0.146500 Jun 23 09:33:20.015455 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 506/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:19 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:20.042475 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:20.043031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:20.049140 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:20.049587 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:20.050354 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:20.050792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:20.128175 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2cdf8211-24aa-43f3-8cd7-491d6201f95f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089970 Jun 23 09:33:20.128770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 526/1032] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jun 23 09:33:20 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:21.357557 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-84f5e262-f395-490c-96da-8a5d20382487 req-100c4584-a5b1-4213-b634-f8e147ada395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1a0af6-1f53-4677-a3a0-4bac58197c29", "tag": "4e4ee781-df17-48a8-b586-45bc48fd55f1"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:21.366566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-84f5e262-f395-490c-96da-8a5d20382487 req-100c4584-a5b1-4213-b634-f8e147ada395 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:21.367224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-84f5e262-f395-490c-96da-8a5d20382487 req-100c4584-a5b1-4213-b634-f8e147ada395 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:21.379697 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-84f5e262-f395-490c-96da-8a5d20382487 req-100c4584-a5b1-4213-b634-f8e147ada395 service nova] Creating event network-changed:4e4ee781-df17-48a8-b586-45bc48fd55f1 for instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 on hv-cinder-84727 Jun 23 09:33:21.385496 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-84f5e262-f395-490c-96da-8a5d20382487 req-100c4584-a5b1-4213-b634-f8e147ada395 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Jun 23 09:33:21.386085 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 507/1033] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:22.404686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:22.407360 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:22.411321 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:22.411770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:22.412532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:22.412975 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:22.498489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lazy-loading 'services' on Instance uuid 4c310931-4054-48c8-84e3-3001196466a7 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:33:22.674416 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:22.767369 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e31306f3-4cf6-41c2-b67f-b0d537a6b5d8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7/os-volume_attachments/a1fd6aac-c37d-4165-af0d-54ccac72b793" status: 202 len: 0 microversion: 2.1 time: 0.367002 Jun 23 09:33:22.767977 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 527/1034] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:33:22 2022] DELETE /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7/os-volume_attachments/a1fd6aac-c37d-4165-af0d-54ccac72b793 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:33:23.878385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:23.878997 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:23.881927 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:23.885558 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:23.886007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:23.886773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:23.887250 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:23.891388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=85 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:23.913476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:33:24.208275 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2b1eabac-2642-4266-917a-cdd302f4e47d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 204 len: 0 microversion: 2.1 time: 0.334378 Jun 23 09:33:24.208861 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 508/1035] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:33:23 2022] DELETE /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:33:24.218829 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:24.219679 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:24.221653 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:24.227410 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:24.227850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:24.231346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:24.231346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:24.365844 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:24.374322 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-80035049-b5e0-4943-8097-ab6fcf5c20b7 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1513 microversion: 2.1 time: 0.160602 Jun 23 09:33:24.374882 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 528/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:24 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:25.393278 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:25.393977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:25.401246 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:25.401692 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:25.402456 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:25.402888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:25.545150 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:25.553148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-97ea187f-1ec1-4242-aed1-2e8d93ddf608 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1513 microversion: 2.1 time: 0.165089 Jun 23 09:33:25.553713 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 509/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:25 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:26.420032 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-7bdca397-903e-433b-8660-cc3d06fa4e34 req-f411ec85-967e-4037-9a5a-d15ed545086d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c310931-4054-48c8-84e3-3001196466a7", "name": "network-vif-deleted", "tag": "d8d8d6b6-e75a-4f00-bb0a-65014005b289"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:26.429551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-7bdca397-903e-433b-8660-cc3d06fa4e34 req-f411ec85-967e-4037-9a5a-d15ed545086d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:26.429991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-7bdca397-903e-433b-8660-cc3d06fa4e34 req-f411ec85-967e-4037-9a5a-d15ed545086d service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:26.440719 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-7bdca397-903e-433b-8660-cc3d06fa4e34 req-f411ec85-967e-4037-9a5a-d15ed545086d service nova] Creating event network-vif-deleted:d8d8d6b6-e75a-4f00-bb0a-65014005b289 for instance 4c310931-4054-48c8-84e3-3001196466a7 on hv-cinder-84727 Jun 23 09:33:26.445753 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-7bdca397-903e-433b-8660-cc3d06fa4e34 req-f411ec85-967e-4037-9a5a-d15ed545086d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030077 Jun 23 09:33:26.446338 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 529/1038] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:26.569675 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:26.570806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:26.577340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:26.577780 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:26.578533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:26.578987 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:26.640314 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:26.648072 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9f0c3595-ae35-43c5-8e5e-62ae07c369f5 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 200 len: 1303 microversion: 2.1 time: 0.082218 Jun 23 09:33:26.649146 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 510/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:26 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:27.666439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:27.667162 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: 4c310931-4054-48c8-84e3-3001196466a7] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:27.674324 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:27.674770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:27.675554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:27.675983 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:27.689899 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] HTTP exception thrown: Instance 4c310931-4054-48c8-84e3-3001196466a7 could not be found. Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Request method failure captured: Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 HTTP/1.1 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDMeNjFKHc1c2YQnpa11KIkrnNyIyqwxbWYuJesqWwJZ9ff9SxDIUUsoQ7zjxOKYDLtvW63NDdRe6Gn-URE68um1j4AbYr5-pMuyaHyfm2ARU0S8pBLN-8Yu5jicNdqXcNjSYsa1_Nvewm33QjzEfuRaco3DEtyOykvPKIV8WhT-7U8 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: e06cabc6fd104c7cbd2758700a0d29a8 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1181812389 Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:33:27.691570 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e06cabc6fd104c7cbd2758700a0d29a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e06cabc6fd104c7cbd2758700a0d29a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e06cabc6fd104c7cbd2758700a0d29a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e06cabc6fd104c7cbd2758700a0d29a8", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesSnapshotTestJSON-1181812389 Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: e06cabc6fd104c7cbd2758700a0d29a8 Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1181812389 Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesSnapshotTestJSON-1181812389-project Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: ee3ad4a33625438fb5c0ae12314689d6 Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesSnapshotTestJSON-1181812389-project Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 4c310931-4054-48c8-84e3-3001196466a7 could not be found. Jun 23 09:33:27.703157 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '4c310931-4054-48c8-84e3-3001196466a7'} Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c310931-4054-48c8-84e3-3001196466a7 could not be found. Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:33:27.704076 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c310931-4054-48c8-84e3-3001196466a7 could not be found. Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c310931-4054-48c8-84e3-3001196466a7 could not be found. Jun 23 09:33:27.705487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:33:27.707154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Returning 404 to user: Instance 4c310931-4054-48c8-84e3-3001196466a7 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:33:27.707154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d66b35a7-6c6a-46cb-9903-2e0fc9e52d08 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7" status: 404 len: 111 microversion: 2.1 time: 0.031348 Jun 23 09:33:27.707154 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 530/1040] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:27 2022] GET /compute/v2.1/servers/4c310931-4054-48c8-84e3-3001196466a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:33:37.158618 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-660018892", "imageRef": "6b101853-e79f-4db2-bc4a-165c86d564d2", "flavorRef": "452", "networks": [{"uuid": "0c5dae6b-c436-4b72-8060-f13fcb71482a"}]}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:37.166503 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:37.167210 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:37.211495 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.network.neutron [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] validate_networks() for [('0c5dae6b-c436-4b72-8060-f13fcb71482a', None, None, None, None, None)] {{(pid=118501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:33:37.567337 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Flavor limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:33:37.567783 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Image limits 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:33:37.568254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Flavor pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:33:37.568707 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Image pref 0:0:0 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:33:37.569062 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.virt.hardware [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:33:37.578242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:37.583001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:37.583001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:37.583001 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:37.597525 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Getting quotas for project e06cabc6fd104c7cbd2758700a0d29a8. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:33:37.602129 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.quota [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Getting quotas for user ee3ad4a33625438fb5c0ae12314689d6 and project e06cabc6fd104c7cbd2758700a0d29a8. Resources: {'instances', 'cores', 'ram'} {{(pid=118501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:33:37.613116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Going to run 1 instances... {{(pid=118501) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:33:37.615619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b101853-e79f-4db2-bc4a-165c86d564d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:33:37.758328 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c46d2b24-af7c-4de0-835b-c6970b2eab75 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603447 Jun 23 09:33:37.758999 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 511/1041] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 09:33:37.769272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-422e6146-8bd7-4602-abf8-9cffb9c0e13d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:37.769893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-422e6146-8bd7-4602-abf8-9cffb9c0e13d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:37.771988 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=10 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:37.825519 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-422e6146-8bd7-4602-abf8-9cffb9c0e13d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:37.832258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-422e6146-8bd7-4602-abf8-9cffb9c0e13d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1218 microversion: 2.1 time: 0.067304 Jun 23 09:33:37.832887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 531/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:37 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:38.849544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:38.850184 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:38.857908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:38.858348 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:38.859131 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:38.859578 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:38.919972 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:38.927691 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1e5a984f-e509-4e6a-9c79-d2f668bbb42c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1222 microversion: 2.1 time: 0.082034 Jun 23 09:33:38.928268 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 512/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:38 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:39.945746 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:39.946506 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:39.954166 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:39.954610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:39.955389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:39.955823 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:40.031224 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:40.039799 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7180d115-498f-4595-8b6d-b4dc158ba384 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1270 microversion: 2.1 time: 0.098606 Jun 23 09:33:40.040481 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 532/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:39 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:41.059846 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:41.060440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:41.066852 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:41.067336 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:41.068098 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:41.068535 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:41.202242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:41.209737 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ce280f36-e96d-4359-a27c-8e6c0fb95b4d tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.153739 Jun 23 09:33:41.211045 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 513/1045] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:41 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:41.898641 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-121e7fcb-6f20-4328-90ee-760212f30e4d req-e389ad92-dbd0-4e4c-8eae-83180fcb1f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f56b2b-7620-4a6a-8b5f-b066ca23c14e", "tag": "e2bd13c7-5c59-4214-84f4-ad78bfa3d5d7"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:41.907546 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-121e7fcb-6f20-4328-90ee-760212f30e4d req-e389ad92-dbd0-4e4c-8eae-83180fcb1f5e service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:41.910869 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-121e7fcb-6f20-4328-90ee-760212f30e4d req-e389ad92-dbd0-4e4c-8eae-83180fcb1f5e service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:41.920529 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-121e7fcb-6f20-4328-90ee-760212f30e4d req-e389ad92-dbd0-4e4c-8eae-83180fcb1f5e service nova] Creating event network-changed:e2bd13c7-5c59-4214-84f4-ad78bfa3d5d7 for instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e on hv-cinder-84727 Jun 23 09:33:41.925655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-121e7fcb-6f20-4328-90ee-760212f30e4d req-e389ad92-dbd0-4e4c-8eae-83180fcb1f5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Jun 23 09:33:41.926783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 533/1046] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:42.227419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:42.228033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:42.234846 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:42.235349 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:42.236122 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:42.236559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:42.374516 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:42.382296 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4475d485-7b8d-4378-8529-8f8f3e83b07c tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.158808 Jun 23 09:33:42.383028 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 514/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:42 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:43.400053 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:43.400751 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:43.407494 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:43.407880 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:43.408633 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:43.409062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:43.546348 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:43.553769 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3fc107af-6667-45ef-b180-63177626ef03 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.158609 Jun 23 09:33:43.554836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 534/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:43 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:44.571546 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:44.572164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:44.579096 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:44.579552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:44.580352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:44.580794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:44.705653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:44.713544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c549d7a5-36d7-40e5-909b-80479b22417f tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.146436 Jun 23 09:33:44.714099 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 515/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:44 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:45.730879 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:45.731449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:45.737911 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:45.738364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:45.739156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:45.739597 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:45.865389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:45.872865 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-cedd5c11-23af-40a5-bca9-adb15a48e760 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.146629 Jun 23 09:33:45.873744 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 535/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:45 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:46.889419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:46.890041 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:46.896523 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:46.897067 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:46.897842 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:46.898260 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:47.025586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:47.033105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-09cf62ba-7c9f-4526-82b1-8be1a59df88b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.147511 Jun 23 09:33:47.033674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 516/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:46 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:47.346957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-c9b2270e-14eb-4752-8a33-0f1b7e879768 req-089a13f8-718b-4959-bf88-ca0d5bfd4ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f56b2b-7620-4a6a-8b5f-b066ca23c14e", "name": "network-vif-plugged", "status": "completed", "tag": "e2bd13c7-5c59-4214-84f4-ad78bfa3d5d7"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:47.356376 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-c9b2270e-14eb-4752-8a33-0f1b7e879768 req-089a13f8-718b-4959-bf88-ca0d5bfd4ce1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:47.356812 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-c9b2270e-14eb-4752-8a33-0f1b7e879768 req-089a13f8-718b-4959-bf88-ca0d5bfd4ce1 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:47.370354 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-c9b2270e-14eb-4752-8a33-0f1b7e879768 req-089a13f8-718b-4959-bf88-ca0d5bfd4ce1 service nova] Creating event network-vif-plugged:e2bd13c7-5c59-4214-84f4-ad78bfa3d5d7 for instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e on hv-cinder-84727 Jun 23 09:33:47.375732 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-c9b2270e-14eb-4752-8a33-0f1b7e879768 req-089a13f8-718b-4959-bf88-ca0d5bfd4ce1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Jun 23 09:33:47.376301 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 536/1052] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:48.050206 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:48.050832 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:48.052672 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:48.053392 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=6 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:48.059164 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:48.059612 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:48.060367 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:48.060799 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:48.187527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:48.195571 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-27e90c0b-693d-4f9f-9889-6a39c8a0e240 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.148636 Jun 23 09:33:48.196139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 517/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:48 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:49.213257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:49.213949 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:49.216087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:33:49.221551 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:49.221993 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:49.223062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:49.223486 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:49.351507 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:49.359062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9288b8e8-bd44-4726-8050-e5b5963f1762 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1318 microversion: 2.1 time: 0.150745 Jun 23 09:33:49.359618 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 537/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:49 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:50.376171 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:50.376787 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:50.383344 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:50.383793 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:50.384551 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:50.384987 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:50.514800 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:33:50.522249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1ea0cb70-d664-41c0-9fce-3bf47cf3574b tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1508 microversion: 2.1 time: 0.150039 Jun 23 09:33:50.523343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 518/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:33:50 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:33:50.545342 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a124911e-a018-4c8e-82c0-bdfaa9e50683", "device": "/dev/sdb"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:50.546434 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:50.552917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:50.553362 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:50.554192 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:50.554626 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:51.352944 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1e2b739f-d6e6-4d64-93c0-62dc8a36757a tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "POST /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811419 Jun 23 09:33:51.353538 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 538/1056] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:33:50 2022] POST /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:33:57.216118 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:33:57.216671 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:57.222724 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:57.223209 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:57.223968 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:57.224402 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:57.247388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-95ff1f1f-aa0c-4329-8f18-6dbf1d07b87b tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/ips" status: 200 len: 145 microversion: 2.1 time: 0.035299 Jun 23 09:33:57.247941 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 519/1057] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:33:57 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:33:58.926111 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10e23597-3062-4af7-842d-96f3eaba5e89"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:33:58.927406 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:33:58.934316 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:58.934767 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:33:58.935560 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:33:58.935995 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:00.012686 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fc53459c-67e3-4892-9824-01f18cbb4450 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.091253 Jun 23 09:34:00.013366 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 539/1058] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:33:58 2022] POST /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments => generated 194 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:09.612550 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:09.613545 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:09.616356 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:09.617623 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=48 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:09.622340 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:09.622789 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:09.623586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:09.624023 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:09.654415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-50042426-49ad-47a4-9538-e8978f1b9bc1 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Jun 23 09:34:09.654983 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 520/1059] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:34:09 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:09.662812 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=25 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:09.667845 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:09.671332 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:09.674614 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:09.675098 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:09.675863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:09.676302 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:09.705801 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-647b884a-92bf-493d-934e-a9e951d556c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/10e23597-3062-4af7-842d-96f3eaba5e89" status: 200 len: 194 microversion: 2.1 time: 0.044314 Jun 23 09:34:09.706386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 540/1060] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jun 23 09:34:09 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/10e23597-3062-4af7-842d-96f3eaba5e89 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:11.288305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:11.288305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:11.293440 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:11.293922 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:11.294303 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59dd20b7-fa77-4e25-a21d-a70887657c72"}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:11.294716 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:11.295148 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:11.295404 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:11.302160 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:11.302613 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:11.303403 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:11.303841 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:11.307490 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:11.439172 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lazy-loading 'services' on Instance uuid a6f56b2b-7620-4a6a-8b5f-b066ca23c14e {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:11.670524 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a0520291-6831-45e6-b94a-bbda0c05b6da tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e/os-volume_attachments/a124911e-a018-4c8e-82c0-bdfaa9e50683" status: 202 len: 0 microversion: 2.1 time: 0.389836 Jun 23 09:34:11.671082 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 521/1061] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:34:11 2022] DELETE /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e/os-volume_attachments/a124911e-a018-4c8e-82c0-bdfaa9e50683 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 09:34:12.074691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-96b3373a-9d46-4ea9-96f8-3e2353b7f518 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "POST /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784113 Jun 23 09:34:12.075355 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 541/1062] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jun 23 09:34:11 2022] POST /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:34:12.781958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:12.785385 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:12.788888 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:12.789343 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:12.790109 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:12.790543 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:12.816010 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:34:13.116490 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-50e97289-cc6f-405b-94bc-058fdc3ee02e tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 204 len: 0 microversion: 2.1 time: 0.339101 Jun 23 09:34:13.117642 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 522/1063] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:34:12 2022] DELETE /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:34:13.126696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:13.127465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:13.133987 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:13.134443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:13.135239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:13.135685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:13.271499 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:13.278887 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-86b928fe-ad46-4c58-a406-f5d08ebc38f8 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1514 microversion: 2.1 time: 0.156849 Jun 23 09:34:13.279468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 542/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:13 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:14.296225 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:14.296977 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:14.303447 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:14.303892 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:14.305141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:14.305599 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:14.430899 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:14.438416 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-619f0c4d-6bf3-4b94-97f4-e1c360e7c2ba tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1514 microversion: 2.1 time: 0.146361 Jun 23 09:34:14.439036 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 523/1065] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:14 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:15.456002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:15.456615 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:15.463126 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:15.463575 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:15.464340 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:15.464779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:15.545316 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:15.555176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e96cef86-a071-4aee-af36-5c59c22081e3 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1472 microversion: 2.1 time: 0.102463 Jun 23 09:34:15.555927 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 543/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:15 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:15.623404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-aab4238a-55e8-4087-b04f-e889fb764580 req-8e5b0e23-48c8-4b09-9f56-b44ccb5d342c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f56b2b-7620-4a6a-8b5f-b066ca23c14e", "name": "network-vif-deleted", "tag": "e2bd13c7-5c59-4214-84f4-ad78bfa3d5d7"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:15.631653 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-aab4238a-55e8-4087-b04f-e889fb764580 req-8e5b0e23-48c8-4b09-9f56-b44ccb5d342c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:15.635228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-aab4238a-55e8-4087-b04f-e889fb764580 req-8e5b0e23-48c8-4b09-9f56-b44ccb5d342c service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:15.643519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-aab4238a-55e8-4087-b04f-e889fb764580 req-8e5b0e23-48c8-4b09-9f56-b44ccb5d342c service nova] Creating event network-vif-deleted:e2bd13c7-5c59-4214-84f4-ad78bfa3d5d7 for instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e on hv-cinder-84727 Jun 23 09:34:15.648659 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-aab4238a-55e8-4087-b04f-e889fb764580 req-8e5b0e23-48c8-4b09-9f56-b44ccb5d342c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028888 Jun 23 09:34:15.650241 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 524/1067] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:16.572719 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:16.573685 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:16.580408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:16.580856 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:16.581623 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:16.582200 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:16.614810 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:16.615559 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:16.616040 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lazy-loading 'fault' on Instance uuid a6f56b2b-7620-4a6a-8b5f-b066ca23c14e {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:16.658832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3ad4a33625438fb5c0ae12314689d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06cabc6fd104c7cbd2758700a0d29a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:16.667190 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a7fe0e50-a9e7-4206-a68a-84b10dfbb9df tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 200 len: 1308 microversion: 2.1 time: 0.098900 Jun 23 09:34:16.667759 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 544/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:16 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:17.691826 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:17.692533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] [instance: a6f56b2b-7620-4a6a-8b5f-b066ca23c14e] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:17.699477 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:17.699929 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:17.700766 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:17.701204 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:17.718848 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] HTTP exception thrown: Instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e could not be found. Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Request method failure captured: Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e HTTP/1.1 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDMeNjFKHc1c2YQnpa11KIkrnNyIyqwxbWYuJesqWwJZ9ff9SxDIUUsoQ7zjxOKYDLtvW63NDdRe6Gn-URE68um1j4AbYr5-pMuyaHyfm2ARU0S8pBLN-8Yu5jicNdqXcNjSYsa1_Nvewm33QjzEfuRaco3DEtyOykvPKIV8WhT-7U8 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: e06cabc6fd104c7cbd2758700a0d29a8 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1181812389 Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:17.720640 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e06cabc6fd104c7cbd2758700a0d29a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e06cabc6fd104c7cbd2758700a0d29a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e06cabc6fd104c7cbd2758700a0d29a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e06cabc6fd104c7cbd2758700a0d29a8", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesSnapshotTestJSON-1181812389 Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: e06cabc6fd104c7cbd2758700a0d29a8 Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1181812389 Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesSnapshotTestJSON-1181812389-project Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: ee3ad4a33625438fb5c0ae12314689d6 Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesSnapshotTestJSON-1181812389-project Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e could not be found. Jun 23 09:34:17.722476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'a6f56b2b-7620-4a6a-8b5f-b066ca23c14e'} Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e could not be found. Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:17.723594 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e could not be found. Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e could not be found. Jun 23 09:34:17.725466 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:17.727242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] Returning 404 to user: Instance a6f56b2b-7620-4a6a-8b5f-b066ca23c14e could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:17.727242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-c06834a6-8ef0-4ec6-9d44-a4732d770866 tempest-VolumesSnapshotTestJSON-1181812389 tempest-VolumesSnapshotTestJSON-1181812389-project] 10.222.0.52 "GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e" status: 404 len: 111 microversion: 2.1 time: 0.035051 Jun 23 09:34:17.727242 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 525/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:17 2022] GET /compute/v2.1/servers/a6f56b2b-7620-4a6a-8b5f-b066ca23c14e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:23.778815 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:23.779858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:23.786495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:23.786981 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:23.787756 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:23.788199 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:23.818525 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7c0c3783-f0ca-4d6d-8f8e-5c70294b5822 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043638 Jun 23 09:34:23.819135 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 545/1070] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:34:23 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:23.968277 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:23.968841 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:23.975320 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:23.975773 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:23.976530 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:23.977622 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:24.005868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9afe2f50-bc59-4d08-b7a9-caeb6e3f7b36 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/10e23597-3062-4af7-842d-96f3eaba5e89" status: 200 len: 194 microversion: 2.1 time: 0.041798 Jun 23 09:34:24.006442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 526/1071] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jun 23 09:34:23 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/10e23597-3062-4af7-842d-96f3eaba5e89 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:24.016045 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:24.016549 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:24.022484 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:24.022957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:24.024231 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:24.024665 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:24.103977 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lazy-loading 'services' on Instance uuid ea1a0af6-1f53-4677-a3a0-4bac58197c29 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:24.371241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c5dd5866-e14c-48d5-8fa0-4d67ac85b9f2 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/10e23597-3062-4af7-842d-96f3eaba5e89" status: 202 len: 0 microversion: 2.1 time: 0.358792 Jun 23 09:34:24.371822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 546/1072] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:34:24 2022] DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/10e23597-3062-4af7-842d-96f3eaba5e89 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:34:26.532797 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:26.533366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:26.540438 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:26.540886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:26.541709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:26.542243 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:26.571032 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ae3785e5-eb48-440d-8288-41987c09660f tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/59dd20b7-fa77-4e25-a21d-a70887657c72" status: 200 len: 194 microversion: 2.1 time: 0.041944 Jun 23 09:34:26.571606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 527/1073] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jun 23 09:34:26 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/59dd20b7-fa77-4e25-a21d-a70887657c72 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:26.582517 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:26.583166 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:26.589496 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:26.590141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:26.600127 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:26.600127 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:26.687092 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lazy-loading 'services' on Instance uuid ea1a0af6-1f53-4677-a3a0-4bac58197c29 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:26.916215 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-37fbcac6-cb3f-4682-9f8c-2376699d0000 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/59dd20b7-fa77-4e25-a21d-a70887657c72" status: 202 len: 0 microversion: 2.1 time: 0.338266 Jun 23 09:34:26.916730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 547/1074] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jun 23 09:34:26 2022] DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments/59dd20b7-fa77-4e25-a21d-a70887657c72 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:34:28.076254 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:28.077197 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:28.083338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.083822 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.084598 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.085247 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.116544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b18c7cc2-53ea-4cdb-bc90-f1791277e004 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044103 Jun 23 09:34:28.117098 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 528/1075] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:34:28 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:34:28.224603 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:28.225748 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:28.232630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.233081 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.233840 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.234272 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.263241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d51c8ba5-0f65-491d-977d-9f63af519779 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045515 Jun 23 09:34:28.263796 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 548/1076] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jun 23 09:34:28 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 09:34:28.320813 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:28.321285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:28.327512 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.327958 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.328704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.329136 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.355629 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:34:28.562021 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-91abfced-d344-410a-bf26-4e6235d4e0c8 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 204 len: 0 microversion: 2.1 time: 0.244840 Jun 23 09:34:28.562597 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 529/1077] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:34:28 2022] DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:34:28.570929 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:28.571497 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:28.577473 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.578152 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.578942 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:28.579408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:28.708449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:28.716684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6ef7c50f-4a27-4663-9e79-ec8147503299 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1671 microversion: 2.1 time: 0.149903 Jun 23 09:34:28.717257 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 549/1078] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:28 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:34:29.734703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:29.735459 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:29.742115 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:29.743167 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:29.743927 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:29.744366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:29.878372 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:29.885961 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fa759e0a-ecdc-4483-a1a4-86e1494de223 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1671 microversion: 2.1 time: 0.155514 Jun 23 09:34:29.886516 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 530/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:29 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:30.960144 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:30.960758 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:30.966747 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:30.967245 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:30.968007 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:30.968449 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:31.092681 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:31.100072 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c5c1e4bb-4fef-40de-afd9-58ed6bf1ab05 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1671 microversion: 2.1 time: 0.201066 Jun 23 09:34:31.100635 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 550/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:30 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:32.118663 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:32.119219 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:32.125723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:32.126169 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:32.126948 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:32.127391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:32.262017 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:32.279129 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-fb4fa9a9-d9b8-45a9-a282-fa9a83c0140d tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1671 microversion: 2.1 time: 0.165163 Jun 23 09:34:32.279730 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 531/1081] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:32 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:33.296836 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:33.297510 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:33.304386 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:33.305461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:33.306259 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:33.306701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:33.689923 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:33.698258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-e094311c-7f56-432a-b7a3-2b6a514f1fe4 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1671 microversion: 2.1 time: 0.405497 Jun 23 09:34:33.698831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 551/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:33 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:34.185231 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-82e31719-57ef-4d85-ae83-916bd7d0d333 req-72e0112e-6d54-43ce-a5b4-a2ebfbc1145a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1a0af6-1f53-4677-a3a0-4bac58197c29", "name": "network-vif-deleted", "tag": "4e4ee781-df17-48a8-b586-45bc48fd55f1"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:34.195117 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-82e31719-57ef-4d85-ae83-916bd7d0d333 req-72e0112e-6d54-43ce-a5b4-a2ebfbc1145a service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:34.199061 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-82e31719-57ef-4d85-ae83-916bd7d0d333 req-72e0112e-6d54-43ce-a5b4-a2ebfbc1145a service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:34.206993 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-82e31719-57ef-4d85-ae83-916bd7d0d333 req-72e0112e-6d54-43ce-a5b4-a2ebfbc1145a service nova] Creating event network-vif-deleted:4e4ee781-df17-48a8-b586-45bc48fd55f1 for instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 on hv-cinder-84727 Jun 23 09:34:34.212039 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-82e31719-57ef-4d85-ae83-916bd7d0d333 req-72e0112e-6d54-43ce-a5b4-a2ebfbc1145a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030849 Jun 23 09:34:34.212631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 532/1083] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:34.705391 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:34.706013 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:34.713926 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:34.714671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:34.715850 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:34.716285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:34.716500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:34.716984 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:34.723723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:34.724253 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:34.725258 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:34.725775 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:34.745973 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:34:34.757462 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:34.758442 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:34.758889 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.objects.instance [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lazy-loading 'fault' on Instance uuid ea1a0af6-1f53-4677-a3a0-4bac58197c29 {{(pid=118501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:34.803120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:34.811321 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0dcfab0d-cd90-470f-aa4c-e95f8681c036 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1327 microversion: 2.1 time: 0.098940 Jun 23 09:34:34.811907 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 533/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:34 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:35.080563 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-063ce77d-1988-4770-b6b0-76741ce0ebbf tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 204 len: 0 microversion: 2.1 time: 0.378837 Jun 23 09:34:35.081171 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 552/1085] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:34:34 2022] DELETE /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:34:35.089883 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:35.093015 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:35.096936 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:35.097405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:35.098192 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:35.098633 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:35.103276 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:35.250942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:35.259318 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-61ceceeb-be92-4315-a735-5c3fd8c1f33c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1579 microversion: 2.1 time: 0.173846 Jun 23 09:34:35.259880 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 534/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:35 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1579 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:35.829690 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:35.830394 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:35.836870 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:35.837317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:35.838078 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:35.838513 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:35.843236 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:35.872300 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:35.872779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:35.873228 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lazy-loading 'fault' on Instance uuid ea1a0af6-1f53-4677-a3a0-4bac58197c29 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:35.915885 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0d4416e74a4126a6aa1ccf58e22ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a424690e5b44d58c27c5f872c38bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:35.923621 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3c9359a7-1763-41a9-bd89-4ea295565537 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 200 len: 1327 microversion: 2.1 time: 0.098216 Jun 23 09:34:35.924176 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 553/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:35 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:36.276674 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:36.277296 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:36.284480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:36.285160 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:36.285953 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:36.286391 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:36.425974 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:36.437750 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-e0410c29-10ab-4f51-8f89-eef55e21ca39 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1579 microversion: 2.1 time: 0.164963 Jun 23 09:34:36.438345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 535/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:36 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:36.941267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:36.944036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:36.949239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:36.949694 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:36.950463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:36.950906 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:36.965023 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] HTTP exception thrown: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Request method failure captured: Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 HTTP/1.1 Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDJ6wnBjQY-eLI121_ArkHD5MXYkstxb7R3QVrXYE8aW-2cOHliX4rXqbBvcVKLWOXscWfB2oJp3bec26Ebz5hNoyLLYdRKzmhPAxcLKjNtxKf_KvGMKcuIB_qpg6Gj-f5CGJjrXRnGwa-2K2VjI7IGY4RlYi9YFpLH5rIMruzR5E2k Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:34:36.966671 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19a424690e5b44d58c27c5f872c38bd4", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 9f0d4416e74a4126a6aa1ccf58e22ee3 Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:36.968586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'ea1a0af6-1f53-4677-a3a0-4bac58197c29'} Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:36.969917 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:36.971697 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:36.979286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Returning 404 to user: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:36.979286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-50c001d4-f2c6-4e06-b1f5-b152df541469 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 404 len: 111 microversion: 2.1 time: 0.030764 Jun 23 09:34:36.979286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 554/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:36 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:36.979544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ace320bc-2f47-4391-a714-4fa7ea72d332 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '.version_select at 0x7f8270b4b550>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:37.078631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ace320bc-2f47-4391-a714-4fa7ea72d332 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896427009" status: 202 len: 0 microversion: 2.1 time: 0.099717 Jun 23 09:34:37.078631 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 536/1090] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jun 23 09:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896427009 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:34:37.455529 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:37.456145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:37.463292 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:37.464004 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:37.464957 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:37.465406 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:37.549655 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:37.559676 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-83905205-4dcf-48c8-8ae6-8adbb100d6b1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1511 microversion: 2.1 time: 0.108150 Jun 23 09:34:37.560981 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 555/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:37 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:37.741076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-833bfb22-071e-41d2-ac5c-28a3ca0ec883 req-0081742c-f07f-4a52-8e65-09faba3bd126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147", "name": "network-vif-deleted", "tag": "08844799-4090-4da0-968c-37240d55bee9"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:37.750650 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-833bfb22-071e-41d2-ac5c-28a3ca0ec883 req-0081742c-f07f-4a52-8e65-09faba3bd126 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:37.751227 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-833bfb22-071e-41d2-ac5c-28a3ca0ec883 req-0081742c-f07f-4a52-8e65-09faba3bd126 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:37.764300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-833bfb22-071e-41d2-ac5c-28a3ca0ec883 req-0081742c-f07f-4a52-8e65-09faba3bd126 service nova] Creating event network-vif-deleted:08844799-4090-4da0-968c-37240d55bee9 for instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 on hv-cinder-84727 Jun 23 09:34:37.769627 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-833bfb22-071e-41d2-ac5c-28a3ca0ec883 req-0081742c-f07f-4a52-8e65-09faba3bd126 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118478 Jun 23 09:34:37.773912 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 537/1092] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:38.577623 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:38.578230 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:38.585046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:38.585958 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:38.586317 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:38.586767 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:38.622042 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:38.622491 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:38.622991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lazy-loading 'fault' on Instance uuid 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:34:38.668165 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:38.675331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-f48553d6-c8b3-4631-9d9f-017c414a6776 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 200 len: 1231 microversion: 2.1 time: 0.100750 Jun 23 09:34:38.675331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 556/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:38 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:39.693198 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:39.693891 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:39.700115 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:39.700558 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:39.701308 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:39.701737 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:39.715309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] HTTP exception thrown: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Request method failure captured: Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 HTTP/1.1 Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDLxf_6kvri3WWl0fJag_poW8xoWH7fV-r2-QzgfuXZxAe6sZzBmk_JUnUox-QdjyTCxUBrrPNPj4oUCRoJWCMLfRN_9kmGRuyUHlJAWvAdJeVtzuecBjiiqum5N32lI-sKuQgsyMLYz1TzSQY6EIecDcs6Vvr9FJvF4yXBs-VvzAcA Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:39.723305 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a100fa3c9d124f9089173a35a1e3691d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 86a640cdceb34bb9bfbb7b769e797d30 Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:34:39.725641 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147'} Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:39.727374 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:34:39.729068 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:39.730533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Returning 404 to user: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:39.730533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a1537752-a2aa-4bb6-8568-c0d119198e20 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jun 23 09:34:39.730533 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 538/1094] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:39 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:39.817068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-495712147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1906002326", "security_groups": [{"name": "tempest-secgroup-smoke-1018351472"}], "block_device_mapping_v2": [{"uuid": "d3856698-a0aa-4822-95ac-4101be415468", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "88fe912b-da29-4c17-ab52-b1ab29cc85c5"}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:39.928273 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] validate_networks() for [('88fe912b-da29-4c17-ab52-b1ab29cc85c5', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:34:40.409526 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:34:40.409943 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:34:40.410409 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:34:40.410809 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:34:40.411394 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:34:40.420130 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:40.420612 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:40.421456 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:40.421883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:40.438586 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for project a100fa3c9d124f9089173a35a1e3691d. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:34:40.442523 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for user 86a640cdceb34bb9bfbb7b769e797d30 and project a100fa3c9d124f9089173a35a1e3691d. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:34:40.501884 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:34:40.504126 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3856698-a0aa-4822-95ac-4101be415468',volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:34:40.565682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:40.566182 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:40.572874 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:40.573319 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:40.574071 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:40.574535 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:40.587704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] HTTP exception thrown: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Request method failure captured: Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 HTTP/1.1 Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDJ6wnBjQY-eLI121_ArkHD5MXYkstxb7R3QVrXYE8aW-2cOHliX4rXqbBvcVKLWOXscWfB2oJp3bec26Ebz5hNoyLLYdRKzmhPAxcLKjNtxKf_KvGMKcuIB_qpg6Gj-f5CGJjrXRnGwa-2K2VjI7IGY4RlYi9YFpLH5rIMruzR5E2k Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:40.589228 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19a424690e5b44d58c27c5f872c38bd4", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 9f0d4416e74a4126a6aa1ccf58e22ee3 Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.590903 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'ea1a0af6-1f53-4677-a3a0-4bac58197c29'} Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:40.592033 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.593595 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.595300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Returning 404 to user: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:40.595300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b4822b8e-4995-41ea-893e-81f9572d13c7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 404 len: 111 microversion: 2.1 time: 0.028851 Jun 23 09:34:40.595300 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 539/1095] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:34:40 2022] DELETE /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:34:40.598719 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:40.599405 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: ea1a0af6-1f53-4677-a3a0-4bac58197c29] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:40.605181 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:40.608834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:40.608834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:40.608834 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:40.620646 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] HTTP exception thrown: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Request method failure captured: Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 HTTP/1.1 Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDJ6wnBjQY-eLI121_ArkHD5MXYkstxb7R3QVrXYE8aW-2cOHliX4rXqbBvcVKLWOXscWfB2oJp3bec26Ebz5hNoyLLYdRKzmhPAxcLKjNtxKf_KvGMKcuIB_qpg6Gj-f5CGJjrXRnGwa-2K2VjI7IGY4RlYi9YFpLH5rIMruzR5E2k Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:40.622141 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19a424690e5b44d58c27c5f872c38bd4", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 9f0d4416e74a4126a6aa1ccf58e22ee3 Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.624013 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'ea1a0af6-1f53-4677-a3a0-4bac58197c29'} Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:40.624976 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. Jun 23 09:34:40.626609 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:40.628064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Returning 404 to user: Instance ea1a0af6-1f53-4677-a3a0-4bac58197c29 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:40.628064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-467293f1-b1df-4459-8962-90ccbe8e2c62 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29" status: 404 len: 111 microversion: 2.1 time: 0.028424 Jun 23 09:34:40.628064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 540/1096] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:40 2022] GET /compute/v2.1/servers/ea1a0af6-1f53-4677-a3a0-4bac58197c29 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 09:34:40.991094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-231e34d9-88b2-40f0-830e-b872cc1993f0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.177578 Jun 23 09:34:40.991757 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 557/1097] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:34:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:34:41.002301 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-99635a85-faaf-48f1-8765-2f2498ce966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:41.002934 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-99635a85-faaf-48f1-8765-2f2498ce966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:41.057625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-99635a85-faaf-48f1-8765-2f2498ce966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:41.064362 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-99635a85-faaf-48f1-8765-2f2498ce966d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1094 microversion: 2.1 time: 0.065857 Jun 23 09:34:41.067005 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 541/1098] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:40 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:41.924087 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:41.924723 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:41.927134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:41.933542 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:41.943296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:41.943296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:41.943296 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:41.949440 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] HTTP exception thrown: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Request method failure captured: Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df HTTP/1.1 Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDJ6wnBjQY-eLI121_ArkHD5MXYkstxb7R3QVrXYE8aW-2cOHliX4rXqbBvcVKLWOXscWfB2oJp3bec26Ebz5hNoyLLYdRKzmhPAxcLKjNtxKf_KvGMKcuIB_qpg6Gj-f5CGJjrXRnGwa-2K2VjI7IGY4RlYi9YFpLH5rIMruzR5E2k Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:34:41.951014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19a424690e5b44d58c27c5f872c38bd4", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 9f0d4416e74a4126a6aa1ccf58e22ee3 Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.952712 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '575ce77f-535c-48bb-b311-7c7c515b82df'} Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:41.953766 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.956262 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.957960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Returning 404 to user: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:41.957960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a0c9bfdf-b6e9-4bfe-9018-30eb8fa3e4a7 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 404 len: 111 microversion: 2.1 time: 0.032927 Jun 23 09:34:41.957960 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 558/1099] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:34:41 2022] DELETE /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:41.960677 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:41.961299 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] [instance: 575ce77f-535c-48bb-b311-7c7c515b82df] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:41.964224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:41.969331 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:41.969785 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:41.970566 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:41.971151 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:41.988714 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] HTTP exception thrown: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Request method failure captured: Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df HTTP/1.1 Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDJ6wnBjQY-eLI121_ArkHD5MXYkstxb7R3QVrXYE8aW-2cOHliX4rXqbBvcVKLWOXscWfB2oJp3bec26Ebz5hNoyLLYdRKzmhPAxcLKjNtxKf_KvGMKcuIB_qpg6Gj-f5CGJjrXRnGwa-2K2VjI7IGY4RlYi9YFpLH5rIMruzR5E2k Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:41.990424 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19a424690e5b44d58c27c5f872c38bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19a424690e5b44d58c27c5f872c38bd4", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 19a424690e5b44d58c27c5f872c38bd4 Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-442259189 Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 9f0d4416e74a4126a6aa1ccf58e22ee3 Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-AttachVolumeTestJSON-442259189-project Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.993056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '575ce77f-535c-48bb-b311-7c7c515b82df'} Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:41.994056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. Jun 23 09:34:41.995794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:41.997287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] Returning 404 to user: Instance 575ce77f-535c-48bb-b311-7c7c515b82df could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:41.997287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-82cd1b92-9da1-4ac3-b093-9f357ac43268 tempest-AttachVolumeTestJSON-442259189 tempest-AttachVolumeTestJSON-442259189-project] 10.222.0.52 "GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df" status: 404 len: 111 microversion: 2.1 time: 0.035208 Jun 23 09:34:41.997287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 542/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:41 2022] GET /compute/v2.1/servers/575ce77f-535c-48bb-b311-7c7c515b82df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:42.081628 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:42.082256 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:42.088928 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:42.089375 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:42.090144 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:42.090579 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:42.183443 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:42.191465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-26f10964-6ceb-4cda-88ea-c7e6244dbfff tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1144 microversion: 2.1 time: 0.113755 Jun 23 09:34:42.192046 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 559/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:42 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1144 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:43.209076 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:43.216345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:43.230504 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:43.236074 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:43.237240 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:43.240989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:43.318500 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:43.330470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-2fdb09b8-7145-4b7e-a107-cf16e39a3932 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1200 microversion: 2.1 time: 0.121532 Jun 23 09:34:43.330470 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 543/1102] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:43 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1200 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:44.346265 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:44.347590 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:44.359843 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:44.361238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:44.362268 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:44.362939 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:44.453893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:44.470374 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-78dc3280-fa5e-4c22-8afd-e935aab20a45 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1210 microversion: 2.1 time: 0.130042 Jun 23 09:34:44.472700 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 560/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:44 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:45.505791 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:45.506502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:45.516528 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:45.517094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:45.518115 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:45.519404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:45.788066 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:45.795704 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-79801e53-29d7-41e8-a1d3-6903d6b6bb6d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.307762 Jun 23 09:34:45.796256 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 544/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:45 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:46.335907 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-5b8d9d81-55c0-4740-a635-c36292cb2457 req-bdb0f9c2-7476-4cf9-acb3-c8bcff70de92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04b8db5-ba9f-4327-b57c-51c3462e3efa", "tag": "f892b7da-7cfb-4af4-98f8-866d8071f8b1"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:46.349123 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-5b8d9d81-55c0-4740-a635-c36292cb2457 req-bdb0f9c2-7476-4cf9-acb3-c8bcff70de92 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:46.361385 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-5b8d9d81-55c0-4740-a635-c36292cb2457 req-bdb0f9c2-7476-4cf9-acb3-c8bcff70de92 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:46.380851 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-5b8d9d81-55c0-4740-a635-c36292cb2457 req-bdb0f9c2-7476-4cf9-acb3-c8bcff70de92 service nova] Creating event network-changed:f892b7da-7cfb-4af4-98f8-866d8071f8b1 for instance e04b8db5-ba9f-4327-b57c-51c3462e3efa on hv-cinder-84727 Jun 23 09:34:46.386893 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-5b8d9d81-55c0-4740-a635-c36292cb2457 req-bdb0f9c2-7476-4cf9-acb3-c8bcff70de92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055550 Jun 23 09:34:46.393699 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 561/1105] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:46.813333 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:46.814625 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:46.821940 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:46.822387 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:46.823186 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:46.823619 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:47.089935 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:47.101469 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-d16f7f80-ccaf-46b4-9915-4eea66531cf7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.292649 Jun 23 09:34:47.106224 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 545/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:46 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:48.119919 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:48.120630 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:48.128051 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:48.128725 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:48.129500 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:48.129939 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:48.267811 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:48.275548 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-709f01d8-6b93-49b9-a789-c6a9ba58e222 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.160629 Jun 23 09:34:48.276101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 562/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:48 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:49.292363 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:49.293064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:49.299489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:49.299930 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:49.300687 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:49.301156 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:49.356559 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-50826812-a65d-4814-aa06-0d8f56520036 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Action: 'create', calling method: .version_select at 0x7f8270c155e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-654289312", "metadata": {"Type": "work"}}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-50826812-a65d-4814-aa06-0d8f56520036 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Request method failure captured: Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 121 Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDO52F53KdrmgR16wGUpAfS0mirz99UiaszmjvlcoYvbaPk48-z7qKCaEVFxg_Wnxb3oBc8tmK1CZLO0Q-D0V2p7JBIQRMVQYc2ldNPvgT4PPiQlvr4q9ylTaUnPQQvzvcjlqxPIvaOeDUkmFTBiCbpRPe-lHbDskFhr2zieb_BLIbo Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:49.390635 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b5047101a0142e1ab06e6a2ec39cf2f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 73c41cfe5eb04ea1b9c2c175ea84215c Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-654289312", "metadata": {"Type": "work"}}} Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: Jun 23 09:34:49.392507 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-654289312', 'metadata': {'Type': 'work'}}}} Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise error Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:49.393493 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 09:34:49.399931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 09:34:49.401431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 09:34:49.401431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.401431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-50826812-a65d-4814-aa06-0d8f56520036 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:49.401431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-50826812-a65d-4814-aa06-0d8f56520036 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152752 Jun 23 09:34:49.401431 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 546/1108] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jun 23 09:34:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:34:49.405231 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-83ce9492-a28c-4a79-8cb0-d96662a3dcc5 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Action: 'create', calling method: .version_select at 0x7f8270b6c550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-693161887", "metadata": {"Type": "work"}}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-83ce9492-a28c-4a79-8cb0-d96662a3dcc5 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Request method failure captured: Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 119 Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDO52F53KdrmgR16wGUpAfS0mirz99UiaszmjvlcoYvbaPk48-z7qKCaEVFxg_Wnxb3oBc8tmK1CZLO0Q-D0V2p7JBIQRMVQYc2ldNPvgT4PPiQlvr4q9ylTaUnPQQvzvcjlqxPIvaOeDUkmFTBiCbpRPe-lHbDskFhr2zieb_BLIbo Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:49.407586 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b5047101a0142e1ab06e6a2ec39cf2f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 73c41cfe5eb04ea1b9c2c175ea84215c Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-693161887", "metadata": {"Type": "work"}}} Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: Jun 23 09:34:49.409317 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-693161887', 'metadata': {'Type': 'work'}}}} Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise error Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi '0' Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:49.412802 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 09:34:49.414552 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 09:34:49.416147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 09:34:49.416147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.416147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-83ce9492-a28c-4a79-8cb0-d96662a3dcc5 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:49.416147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-83ce9492-a28c-4a79-8cb0-d96662a3dcc5 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007391 Jun 23 09:34:49.416147 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 547/1109] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jun 23 09:34:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 09:34:49.418621 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-127fbdf2-b8eb-4437-a15a-72b80ff52b97 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Action: 'create', calling method: .version_select at 0x7f827091f700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1790812571", "metadata": {"Type": "work"}}} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-127fbdf2-b8eb-4437-a15a-72b80ff52b97 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Request method failure captured: Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 119 Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDO52F53KdrmgR16wGUpAfS0mirz99UiaszmjvlcoYvbaPk48-z7qKCaEVFxg_Wnxb3oBc8tmK1CZLO0Q-D0V2p7JBIQRMVQYc2ldNPvgT4PPiQlvr4q9ylTaUnPQQvzvcjlqxPIvaOeDUkmFTBiCbpRPe-lHbDskFhr2zieb_BLIbo Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:49.421280 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b5047101a0142e1ab06e6a2ec39cf2f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 73c41cfe5eb04ea1b9c2c175ea84215c Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1790812571", "metadata": {"Type": "work"}}} Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: Jun 23 09:34:49.423079 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1790812571', 'metadata': {'Type': 'work'}}}} Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise error Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi '' Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:49.424478 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 09:34:49.426439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 09:34:49.427989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 09:34:49.427989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.427989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-127fbdf2-b8eb-4437-a15a-72b80ff52b97 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:49.427989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-127fbdf2-b8eb-4437-a15a-72b80ff52b97 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008302 Jun 23 09:34:49.427989 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 548/1110] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jun 23 09:34:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 09:34:49.433065 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a2b5f514-aa0d-4144-80e2-a8a3398f8ba1 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Calling method '.version_select at 0x7f8270c15a60>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:49.436221 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:49.444208 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-6f5adce9-2f72-4030-a285-259bf33bedac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.155827 Jun 23 09:34:49.444990 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 563/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:49 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:34:49.461978 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-a2b5f514-aa0d-4144-80e2-a8a3398f8ba1 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] HTTP exception thrown: Volume tempest-invalid-172886656 could not be found. Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a2b5f514-aa0d-4144-80e2-a8a3398f8ba1 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Request method failure captured: Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-172886656 HTTP/1.1 Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDO52F53KdrmgR16wGUpAfS0mirz99UiaszmjvlcoYvbaPk48-z7qKCaEVFxg_Wnxb3oBc8tmK1CZLO0Q-D0V2p7JBIQRMVQYc2ldNPvgT4PPiQlvr4q9ylTaUnPQQvzvcjlqxPIvaOeDUkmFTBiCbpRPe-lHbDskFhr2zieb_BLIbo Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:49.463970 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b5047101a0142e1ab06e6a2ec39cf2f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 73c41cfe5eb04ea1b9c2c175ea84215c Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Volume tempest-invalid-172886656 could not be found. Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'tempest-invalid-172886656'} Jun 23 09:34:49.465667 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-172886656 could not be found. (HTTP 404) (Request-ID: req-d9454dc0-1c6c-4a38-99d6-9457bece4036) Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.466765 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 09:34:49.468380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-172886656 could not be found. Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:49.469720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-172886656 could not be found. Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-172886656 could not be found. Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-a2b5f514-aa0d-4144-80e2-a8a3398f8ba1 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Returning 404 to user: Volume tempest-invalid-172886656 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-a2b5f514-aa0d-4144-80e2-a8a3398f8ba1 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-172886656" status: 404 len: 98 microversion: 2.1 time: 0.036362 Jun 23 09:34:49.471297 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 549/1112] 10.222.0.52 () {58 vars in 1214 bytes} [Thu Jun 23 09:34:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-172886656 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 23 09:34:49.474696 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3b496b67-b517-4f05-963d-922c8a3540a1 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003723 Jun 23 09:34:49.475241 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 564/1113] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Jun 23 09:34:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 09:34:49.484249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-709df162-ddf0-4ba7-b1ab-9d46feb3a119 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004377 Jun 23 09:34:49.484723 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 550/1114] 10.222.0.52 () {58 vars in 1136 bytes} [Thu Jun 23 09:34:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 09:34:49.493223 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fa040c18-ad1f-42fe-9a3c-47a81538e2c8 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Calling method '.version_select at 0x7f82713603a0>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:49.520554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-fa040c18-ad1f-42fe-9a3c-47a81538e2c8 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] HTTP exception thrown: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fa040c18-ad1f-42fe-9a3c-47a81538e2c8 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Request method failure captured: Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/os-volumes/e41b6597-5aa2-4a52-a4e3-86e14f921360 HTTP/1.1 Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDO52F53KdrmgR16wGUpAfS0mirz99UiaszmjvlcoYvbaPk48-z7qKCaEVFxg_Wnxb3oBc8tmK1CZLO0Q-D0V2p7JBIQRMVQYc2ldNPvgT4PPiQlvr4q9ylTaUnPQQvzvcjlqxPIvaOeDUkmFTBiCbpRPe-lHbDskFhr2zieb_BLIbo Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:34:49.522627 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b5047101a0142e1ab06e6a2ec39cf2f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 73c41cfe5eb04ea1b9c2c175ea84215c Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': 'e41b6597-5aa2-4a52-a4e3-86e14f921360'} Jun 23 09:34:49.524421 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. (HTTP 404) (Request-ID: req-6100e14c-05f0-4966-8bd7-5aa1b020414c) Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.525487 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 09:34:49.527036 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 09:34:49.528557 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fa040c18-ad1f-42fe-9a3c-47a81538e2c8 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Returning 404 to user: Volume e41b6597-5aa2-4a52-a4e3-86e14f921360 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fa040c18-ad1f-42fe-9a3c-47a81538e2c8 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e41b6597-5aa2-4a52-a4e3-86e14f921360" status: 404 len: 109 microversion: 2.1 time: 0.035046 Jun 23 09:34:49.530085 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 565/1115] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jun 23 09:34:49 2022] DELETE /compute/v2.1/os-volumes/e41b6597-5aa2-4a52-a4e3-86e14f921360 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:49.535007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-56a092b3-e7a8-432e-8aca-abdeb302d990 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Calling method '.version_select at 0x7f8270b6cd30>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:49.561824 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-56a092b3-e7a8-432e-8aca-abdeb302d990 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] HTTP exception thrown: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-56a092b3-e7a8-432e-8aca-abdeb302d990 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Request method failure captured: Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/os-volumes/1e617897-dbd1-4460-aff4-6851c96e8f85 HTTP/1.1 Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDO52F53KdrmgR16wGUpAfS0mirz99UiaszmjvlcoYvbaPk48-z7qKCaEVFxg_Wnxb3oBc8tmK1CZLO0Q-D0V2p7JBIQRMVQYc2ldNPvgT4PPiQlvr4q9ylTaUnPQQvzvcjlqxPIvaOeDUkmFTBiCbpRPe-lHbDskFhr2zieb_BLIbo Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:34:49.563767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b5047101a0142e1ab06e6a2ec39cf2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b5047101a0142e1ab06e6a2ec39cf2f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: 6b5047101a0142e1ab06e6a2ec39cf2f Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-VolumesNegativeTest-196849902 Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 73c41cfe5eb04ea1b9c2c175ea84215c Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-VolumesNegativeTest-196849902-project Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '1e617897-dbd1-4460-aff4-6851c96e8f85'} Jun 23 09:34:49.565563 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. (HTTP 404) (Request-ID: req-e289bfc3-5371-4af6-8d04-c73bbe50d5fb) Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.566518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 09:34:49.567843 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 09:34:49.569134 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-56a092b3-e7a8-432e-8aca-abdeb302d990 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] Returning 404 to user: Volume 1e617897-dbd1-4460-aff4-6851c96e8f85 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-56a092b3-e7a8-432e-8aca-abdeb302d990 tempest-VolumesNegativeTest-196849902 tempest-VolumesNegativeTest-196849902-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1e617897-dbd1-4460-aff4-6851c96e8f85" status: 404 len: 109 microversion: 2.1 time: 0.034475 Jun 23 09:34:49.571121 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 551/1116] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jun 23 09:34:49 2022] GET /compute/v2.1/os-volumes/1e617897-dbd1-4460-aff4-6851c96e8f85 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:34:50.458075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:50.458845 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:50.463800 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:50.464425 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:50.470356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:50.470814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:50.471626 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:50.472075 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:50.615506 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:50.623759 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-15edc775-a4dd-4282-a387-45c82771b234 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.166941 Jun 23 09:34:50.624258 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 566/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:50 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:51.637497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:34:51.641401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:51.642008 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:51.649140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:51.649585 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:51.650332 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:51.650808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:51.785532 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:51.793230 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f7f861d7-7326-45ef-ad9f-ff3b77c4a1fc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.156915 Jun 23 09:34:51.793925 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 552/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:51 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:52.809439 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:52.810055 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:52.816608 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:52.817061 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:52.817830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:52.818269 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:52.952377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:52.960155 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-0f8a8fd1-07c7-4497-814a-74476359d816 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.154564 Jun 23 09:34:52.961358 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 567/1119] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:52 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:53.978407 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:53.978982 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:53.986072 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:53.990238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:53.990238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:53.990238 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:54.162509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:54.172064 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9832fe7d-3d44-4d17-8348-c7600126e5ba tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.198285 Jun 23 09:34:54.174962 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 553/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:53 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:55.188465 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:55.189062 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:55.196014 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:55.196464 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:55.197233 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:55.197691 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:55.335858 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:55.344002 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d60111da-3c64-4116-b741-3ae1a9035e90 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.159372 Jun 23 09:34:55.344658 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 568/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:55 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:56.361789 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:56.362415 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:56.370347 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:56.370554 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:56.371373 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:56.371809 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:56.522985 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:56.531790 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ce6f1c37-b3e8-47bc-b2fd-b12d7cfdd6f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.174088 Jun 23 09:34:56.532441 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 554/1122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:56 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:57.549442 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:57.550055 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:57.556508 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:57.556950 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:57.557745 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:57.558226 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:57.710323 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:57.714808 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4e45ee8a-1e98-4709-93c2-fdc2bcb4bbe3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.169178 Jun 23 09:34:57.715593 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 569/1123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:57 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:57.880120 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-9ded5be3-bafd-48ab-be91-554bcdfc3022 req-c0256ca9-2751-498c-9181-31db881b5080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04b8db5-ba9f-4327-b57c-51c3462e3efa", "name": "network-vif-plugged", "status": "completed", "tag": "f892b7da-7cfb-4af4-98f8-866d8071f8b1"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:34:57.897519 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-9ded5be3-bafd-48ab-be91-554bcdfc3022 req-c0256ca9-2751-498c-9181-31db881b5080 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:57.897986 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-9ded5be3-bafd-48ab-be91-554bcdfc3022 req-c0256ca9-2751-498c-9181-31db881b5080 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:57.910325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-9ded5be3-bafd-48ab-be91-554bcdfc3022 req-c0256ca9-2751-498c-9181-31db881b5080 service nova] Creating event network-vif-plugged:f892b7da-7cfb-4af4-98f8-866d8071f8b1 for instance e04b8db5-ba9f-4327-b57c-51c3462e3efa on hv-cinder-84727 Jun 23 09:34:57.915480 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-9ded5be3-bafd-48ab-be91-554bcdfc3022 req-c0256ca9-2751-498c-9181-31db881b5080 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180859 Jun 23 09:34:57.916070 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 555/1124] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:34:58.734148 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:58.734709 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:58.741151 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:58.741608 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:58.742364 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:58.742800 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:58.874792 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:34:58.882532 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-c13f1473-9e0f-4c32-a63d-43ade85a9c0d tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1266 microversion: 2.1 time: 0.152779 Jun 23 09:34:58.883124 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 570/1125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:58 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:34:59.900587 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:34:59.901853 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:34:59.908007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:59.908458 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:34:59.909213 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:34:59.909648 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:35:00.049417 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:35:00.056905 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-423d4dcb-a8c5-49d1-803b-5456db29a5f9 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1453 microversion: 2.1 time: 0.160952 Jun 23 09:35:00.057509 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 556/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:34:59 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:35:00.072888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:35:00.073477 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:35:00.079728 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:35:00.080267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:35:00.081094 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:35:00.081592 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:35:00.218700 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:35:00.226248 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-9af95efa-ee3e-4efa-a2f8-7fa93e761372 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1453 microversion: 2.1 time: 0.157317 Jun 23 09:35:00.226830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 571/1127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:35:00 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:35:02.581316 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-8a7b624b-12a1-4b1a-938b-0539dfa071b4 req-817dfc3b-3736-4104-a245-6873218cf358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04b8db5-ba9f-4327-b57c-51c3462e3efa", "tag": "f892b7da-7cfb-4af4-98f8-866d8071f8b1"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:35:02.597309 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-8a7b624b-12a1-4b1a-938b-0539dfa071b4 req-817dfc3b-3736-4104-a245-6873218cf358 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:35:02.597696 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-8a7b624b-12a1-4b1a-938b-0539dfa071b4 req-817dfc3b-3736-4104-a245-6873218cf358 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:35:02.613918 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-8a7b624b-12a1-4b1a-938b-0539dfa071b4 req-817dfc3b-3736-4104-a245-6873218cf358 service nova] Creating event network-changed:f892b7da-7cfb-4af4-98f8-866d8071f8b1 for instance e04b8db5-ba9f-4327-b57c-51c3462e3efa on hv-cinder-84727 Jun 23 09:35:02.621606 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-8a7b624b-12a1-4b1a-938b-0539dfa071b4 req-817dfc3b-3736-4104-a245-6873218cf358 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043865 Jun 23 09:35:02.622535 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 557/1128] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:36:04.128303 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:36:04.129550 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Thu Jun 23 09:36:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:36:37.462682 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:36:37.463312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Thu Jun 23 09:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:36:52.759571 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=23 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:36:52.760331 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=89 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:36:52.764286 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-846750454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1906002326", "security_groups": [{"name": "tempest-secgroup-smoke-1018351472"}], "block_device_mapping_v2": [{"uuid": "2b3c5234-fa03-4dac-a85c-edbbe7f8c676", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "88fe912b-da29-4c17-ab52-b1ab29cc85c5"}]}} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:36:52.875793 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.network.neutron [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] validate_networks() for [('88fe912b-da29-4c17-ab52-b1ab29cc85c5', None, None, None, None, None)] {{(pid=118500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 09:36:53.236714 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Flavor limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 09:36:53.237134 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Image limits 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 09:36:53.237606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Flavor pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 09:36:53.238011 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Image pref 0:0:0 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 09:36:53.238420 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.virt.hardware [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 09:36:53.247602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:53.248050 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:53.248874 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:53.249304 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:53.266124 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for project a100fa3c9d124f9089173a35a1e3691d. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 09:36:53.270593 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.quota [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Getting quotas for user 86a640cdceb34bb9bfbb7b769e797d30 and project a100fa3c9d124f9089173a35a1e3691d. Resources: {'instances', 'cores', 'ram'} {{(pid=118500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 09:36:53.326489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Going to run 1 instances... {{(pid=118500) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 09:36:53.328606 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b3c5234-fa03-4dac-a85c-edbbe7f8c676',volume_size=None,volume_type=None)] {{(pid=118500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 09:36:53.730730 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-1c10f400-43a6-411b-b631-10f5cb61f0f1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.972765 Jun 23 09:36:53.731391 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 572/1129] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jun 23 09:36:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 09:36:53.740449 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=19 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:36:53.741193 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=66 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:36:53.745795 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-0bfbf624-225c-42db-8486-ec4fc7916ee1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:36:53.746497 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-0bfbf624-225c-42db-8486-ec4fc7916ee1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:36:53.807668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-0bfbf624-225c-42db-8486-ec4fc7916ee1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:36:53.820061 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-0bfbf624-225c-42db-8486-ec4fc7916ee1 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1094 microversion: 2.1 time: 0.081448 Jun 23 09:36:53.820831 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 558/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:36:53 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:36:54.842118 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:36:54.842666 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:36:54.849564 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:54.850019 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:54.850795 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:54.851264 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:54.912142 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:36:54.919860 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-4870f50e-ce58-4276-95c1-18ed7184d2de tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1144 microversion: 2.1 time: 0.082351 Jun 23 09:36:54.920463 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 573/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:36:54 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:36:55.937655 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:36:55.938413 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:36:55.945654 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:55.946105 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:55.946868 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:55.947326 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:56.015959 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:36:56.024166 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-28816d75-f65a-4b85-b055-b0c0db3eabe0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1200 microversion: 2.1 time: 0.090515 Jun 23 09:36:56.024738 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 559/1132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:36:55 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:36:57.041165 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:36:57.041830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:36:57.048754 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:57.049202 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:57.049964 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:57.050400 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:57.208370 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:36:57.216061 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-73a1d810-4a50-40ae-9632-44343768f4a0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1278 microversion: 2.1 time: 0.178701 Jun 23 09:36:57.216625 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 574/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:36:57 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:36:57.575703 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-0588a793-4dfd-4435-a5d4-b0f163191ba7 req-bddcfbf6-70c9-422c-95a1-c69b1c3e09a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99ed8d7-7ed4-4c5e-9634-986ae6cc4868", "tag": "959b9b12-cd6f-45c6-af60-57bca4d15da0"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:36:57.585388 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-0588a793-4dfd-4435-a5d4-b0f163191ba7 req-bddcfbf6-70c9-422c-95a1-c69b1c3e09a8 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:57.585914 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-0588a793-4dfd-4435-a5d4-b0f163191ba7 req-bddcfbf6-70c9-422c-95a1-c69b1c3e09a8 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:57.598611 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-0588a793-4dfd-4435-a5d4-b0f163191ba7 req-bddcfbf6-70c9-422c-95a1-c69b1c3e09a8 service nova] Creating event network-changed:959b9b12-cd6f-45c6-af60-57bca4d15da0 for instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 on hv-cinder-84727 Jun 23 09:36:57.604243 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-0588a793-4dfd-4435-a5d4-b0f163191ba7 req-bddcfbf6-70c9-422c-95a1-c69b1c3e09a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032775 Jun 23 09:36:57.604846 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 560/1134] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:36:58.233711 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:36:58.234334 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:36:58.240818 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:58.241269 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:58.242043 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:58.242482 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:58.652602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:36:58.660101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3e2e45a1-b630-4008-929b-7a6b22ded6c0 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.430381 Jun 23 09:36:58.660670 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 575/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:36:58 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:36:59.678352 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:36:59.679088 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:36:59.685197 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:59.685644 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:59.686395 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:36:59.686828 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:36:59.823439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:36:59.854313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-bd1462aa-2c0a-437a-bd3b-3bbe3a3adf17 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.158347 Jun 23 09:36:59.854313 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 561/1136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:36:59 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:00.850271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:00.850891 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:00.857442 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:00.857919 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:00.858684 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:00.859159 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:00.985346 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:00.992863 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ef12fc12-dfee-4ad4-8a0e-dfc88f3927f8 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.147233 Jun 23 09:37:00.993701 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 576/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:00 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:02.009931 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:02.010544 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:02.017089 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:02.017538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:02.018298 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:02.018733 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:02.148312 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:02.156325 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-00176657-b037-4269-8848-27284b14d731 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.150238 Jun 23 09:37:02.156890 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 562/1138] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:02 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:03.173650 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:03.174291 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:03.181401 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:03.181853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:03.182616 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:03.183099 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:03.258441 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=2 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:37:03.277625 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell0:SELECT=6 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:37:03.313601 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:03.320934 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-34858f33-154d-4f7a-b6ce-fe3d4eb8b9fa tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.151206 Jun 23 09:37:03.321489 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 577/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:03 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:04.337581 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:04.338221 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:04.340705 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell0:SELECT=2 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:37:04.345561 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:04.346008 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:04.346767 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:04.347249 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:04.484093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:04.489517 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-9c205538-1aa5-43ad-bb70-f7b4e2c62564 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.155818 Jun 23 09:37:04.490088 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 563/1140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:04 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:05.505755 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:05.506310 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:05.513822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:05.514269 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:05.515089 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:05.515554 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:05.645080 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:05.653064 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-64318774-93f2-4c9e-adfe-899863dd41ac tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.151410 Jun 23 09:37:05.653632 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 578/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:05 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:06.670717 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:06.671319 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:06.677770 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:06.678217 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:06.679007 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:06.679446 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:06.820637 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:06.828239 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-7c700d8f-66ed-4171-ac85-4d278571a5db tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.162133 Jun 23 09:37:06.828807 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 564/1142] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:06 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:07.844991 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:07.845609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:07.852184 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:07.852634 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:07.853395 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:07.854332 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:07.981798 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:07.989276 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-68e00486-90d4-4d33-9ef0-09a6c6fd42c3 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.148135 Jun 23 09:37:07.989830 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 579/1143] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:07 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:08.577040 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-9fbce5f2-e4b4-451c-9975-293c6af8611b req-6cc56748-7690-4c14-a825-e25b0ffd0d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99ed8d7-7ed4-4c5e-9634-986ae6cc4868", "name": "network-vif-plugged", "status": "completed", "tag": "959b9b12-cd6f-45c6-af60-57bca4d15da0"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:37:08.585697 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-9fbce5f2-e4b4-451c-9975-293c6af8611b req-6cc56748-7690-4c14-a825-e25b0ffd0d81 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:08.586138 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-9fbce5f2-e4b4-451c-9975-293c6af8611b req-6cc56748-7690-4c14-a825-e25b0ffd0d81 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:08.597943 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-9fbce5f2-e4b4-451c-9975-293c6af8611b req-6cc56748-7690-4c14-a825-e25b0ffd0d81 service nova] Creating event network-vif-plugged:959b9b12-cd6f-45c6-af60-57bca4d15da0 for instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 on hv-cinder-84727 Jun 23 09:37:08.603472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-9fbce5f2-e4b4-451c-9975-293c6af8611b req-6cc56748-7690-4c14-a825-e25b0ffd0d81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030804 Jun 23 09:37:08.604053 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 565/1144] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:37:09.006814 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:09.007461 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:09.015577 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:09.016022 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:09.016780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:09.017212 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:09.207136 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:09.214609 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-7f494c35-502f-41aa-ae9a-38b28a60fa8a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.211697 Jun 23 09:37:09.215210 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 580/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:09 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:10.232522 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:10.233216 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:10.239584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:10.241355 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:10.241355 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:10.241355 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:10.380433 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:10.388043 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-701e0833-a49d-41ab-94f3-f4a160f7426b tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1266 microversion: 2.1 time: 0.160738 Jun 23 09:37:10.388603 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 566/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:10 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:11.404278 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:11.404866 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:11.411495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:11.411941 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:11.412694 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:11.413126 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:11.617558 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:11.625316 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-dab511e4-7e84-4627-a4e9-224260fa0620 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1453 microversion: 2.1 time: 0.224885 Jun 23 09:37:11.625888 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 581/1147] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:11 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:11.641709 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:37:11.642336 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:37:11.648944 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:11.649404 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:11.650140 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:11.650571 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:11.781243 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:37:11.793439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-150f8c70-b337-46ee-b173-a00d5e9da565 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1453 microversion: 2.1 time: 0.150882 Jun 23 09:37:11.793439 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 567/1148] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:37:11 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:37:13.738047 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-f5c54f4b-b050-45ef-9a3c-24b165e9d10c req-c7240bf8-f5d2-4025-925e-736c4d6b4c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99ed8d7-7ed4-4c5e-9634-986ae6cc4868", "tag": "959b9b12-cd6f-45c6-af60-57bca4d15da0"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:37:13.746929 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-f5c54f4b-b050-45ef-9a3c-24b165e9d10c req-c7240bf8-f5d2-4025-925e-736c4d6b4c90 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:37:13.748179 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-f5c54f4b-b050-45ef-9a3c-24b165e9d10c req-c7240bf8-f5d2-4025-925e-736c4d6b4c90 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:37:13.760239 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-f5c54f4b-b050-45ef-9a3c-24b165e9d10c req-c7240bf8-f5d2-4025-925e-736c4d6b4c90 service nova] Creating event network-changed:959b9b12-cd6f-45c6-af60-57bca4d15da0 for instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 on hv-cinder-84727 Jun 23 09:37:13.768661 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-f5c54f4b-b050-45ef-9a3c-24b165e9d10c req-c7240bf8-f5d2-4025-925e-736c4d6b4c90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Jun 23 09:37:13.769309 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 582/1149] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:38:42.902155 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_api:SELECT=22 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:38:42.902979 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG dbcounter [-] [118501] Writing DB stats nova_cell1:SELECT=46 {{(pid=118501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:38:42.905397 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:38:42.906166 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG dbcounter [-] [118500] Writing DB stats nova_cell1:SELECT=58 {{(pid=118500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:38:42.906794 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:42.907324 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:42.910602 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-a948f3e8-ed98-4580-be0a-3af576903bd7 req-f6d9ef45-d63c-43e4-b186-b5cff2eda109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99ed8d7-7ed4-4c5e-9634-986ae6cc4868", "tag": "959b9b12-cd6f-45c6-af60-57bca4d15da0"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:38:42.913578 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:42.917401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:42.917401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:42.917401 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:42.918949 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-a948f3e8-ed98-4580-be0a-3af576903bd7 req-f6d9ef45-d63c-43e4-b186-b5cff2eda109 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:42.919392 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-a948f3e8-ed98-4580-be0a-3af576903bd7 req-f6d9ef45-d63c-43e4-b186-b5cff2eda109 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:42.930820 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-a948f3e8-ed98-4580-be0a-3af576903bd7 req-f6d9ef45-d63c-43e4-b186-b5cff2eda109 service nova] Creating event network-changed:959b9b12-cd6f-45c6-af60-57bca4d15da0 for instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 on hv-cinder-84727 Jun 23 09:38:42.936935 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-a948f3e8-ed98-4580-be0a-3af576903bd7 req-f6d9ef45-d63c-43e4-b186-b5cff2eda109 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033449 Jun 23 09:38:42.940402 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 583/1150] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 09:38:42.942588 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Going to try to terminate instance {{(pid=118501) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:38:43.237668 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ca0bac18-f45c-45a1-a12d-6a9384dee88a tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 204 len: 0 microversion: 2.1 time: 0.336399 Jun 23 09:38:43.239678 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 568/1151] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:38:42 2022] DELETE /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:38:43.248831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:43.249610 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:43.258308 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:43.258835 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:43.259848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:43.260424 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:43.400735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:43.408495 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-2d67dc27-e129-4982-9e2d-06f02171a648 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1578 microversion: 2.1 time: 0.164448 Jun 23 09:38:43.409068 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 584/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:43 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:38:44.426800 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:44.427527 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:44.434482 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:44.434942 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:44.435710 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:44.436139 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:44.571437 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:44.579157 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-ac359fd4-0a9a-41ea-9fa4-7717753564f4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1578 microversion: 2.1 time: 0.157304 Jun 23 09:38:44.579715 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 569/1153] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:44 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:38:45.565093 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [req-4328cf00-b35e-4ddc-8176-1560ab1b737c req-928dd30c-5748-4fd7-9a97-d0586a19e7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99ed8d7-7ed4-4c5e-9634-986ae6cc4868", "name": "network-vif-deleted", "tag": "959b9b12-cd6f-45c6-af60-57bca4d15da0"}]} {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:38:45.568785 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4328cf00-b35e-4ddc-8176-1560ab1b737c req-928dd30c-5748-4fd7-9a97-d0586a19e7aa service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:45.569238 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [req-4328cf00-b35e-4ddc-8176-1560ab1b737c req-928dd30c-5748-4fd7-9a97-d0586a19e7aa service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:45.579894 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.compute.server_external_events [req-4328cf00-b35e-4ddc-8176-1560ab1b737c req-928dd30c-5748-4fd7-9a97-d0586a19e7aa service nova] Creating event network-vif-deleted:959b9b12-cd6f-45c6-af60-57bca4d15da0 for instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 on hv-cinder-84727 Jun 23 09:38:45.584561 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [req-4328cf00-b35e-4ddc-8176-1560ab1b737c req-928dd30c-5748-4fd7-9a97-d0586a19e7aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028434 Jun 23 09:38:45.585141 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 585/1154] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:38:45.597502 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:45.598116 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:45.604725 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:45.612518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:45.612518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:45.612518 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:45.667933 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:45.675927 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-f4289490-0e3e-4e30-8dc4-5b5028e3f34c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1391 microversion: 2.1 time: 0.081741 Jun 23 09:38:45.676491 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 570/1155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:45 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:38:46.695595 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:46.696293 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:46.702408 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:46.702848 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:46.703639 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:46.704071 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:46.740689 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:46.741133 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:46.741577 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.objects.instance [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lazy-loading 'fault' on Instance uuid d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 {{(pid=118500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 09:38:46.783533 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:46.790959 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-d86386ab-d814-4892-a302-b87cbcb2b3f5 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 200 len: 1230 microversion: 2.1 time: 0.101236 Jun 23 09:38:46.791783 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 586/1156] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:46 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:38:47.808287 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:47.808908 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: d99ed8d7-7ed4-4c5e-9634-986ae6cc4868] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:47.815505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:47.815956 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:47.816720 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:47.817162 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:47.833058 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] HTTP exception thrown: Instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 could not be found. Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Request method failure captured: Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 HTTP/1.1 Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDLxf_6kvri3WWl0fJag_poW8xoWH7fV-r2-QzgfuXZxAe6sZzBmk_JUnUox-QdjyTCxUBrrPNPj4oUCRoJWCMLfRN_9kmGRuyUHlJAWvAdJeVtzuecBjiiqum5N32lI-sKuQgsyMLYz1TzSQY6EIecDcs6Vvr9FJvF4yXBs-VvzAcA Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:38:47.834669 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a100fa3c9d124f9089173a35a1e3691d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 86a640cdceb34bb9bfbb7b769e797d30 Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 could not be found. Jun 23 09:38:47.836602 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'd99ed8d7-7ed4-4c5e-9634-986ae6cc4868'} Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 could not be found. Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:38:47.837764 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 could not be found. Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 could not be found. Jun 23 09:38:47.839806 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:47.841419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Returning 404 to user: Instance d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:38:47.841419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-71581b0f-6a1e-4c7e-89e6-3a04f0e8d437 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868" status: 404 len: 111 microversion: 2.1 time: 0.031737 Jun 23 09:38:47.841419 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 571/1157] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:47 2022] GET /compute/v2.1/servers/d99ed8d7-7ed4-4c5e-9634-986ae6cc4868 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:38:51.263201 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:51.263718 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:51.265235 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-bb98aff4-c25e-49a9-b12d-9508265178bd req-d385b3ea-03b8-440b-81b4-8507a7c61dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04b8db5-ba9f-4327-b57c-51c3462e3efa", "tag": "f892b7da-7cfb-4af4-98f8-866d8071f8b1"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:38:51.270832 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:51.271412 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:51.272267 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:51.272779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:51.273634 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-bb98aff4-c25e-49a9-b12d-9508265178bd req-d385b3ea-03b8-440b-81b4-8507a7c61dbf service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:51.274075 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-bb98aff4-c25e-49a9-b12d-9508265178bd req-d385b3ea-03b8-440b-81b4-8507a7c61dbf service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:51.286769 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-bb98aff4-c25e-49a9-b12d-9508265178bd req-d385b3ea-03b8-440b-81b4-8507a7c61dbf service nova] Creating event network-changed:f892b7da-7cfb-4af4-98f8-866d8071f8b1 for instance e04b8db5-ba9f-4327-b57c-51c3462e3efa on hv-cinder-84727 Jun 23 09:38:51.292472 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-bb98aff4-c25e-49a9-b12d-9508265178bd req-d385b3ea-03b8-440b-81b4-8507a7c61dbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030803 Jun 23 09:38:51.294201 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 572/1158] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:38:51.300240 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Going to try to terminate instance {{(pid=118500) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 09:38:51.607503 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-a8d2472f-b77a-43ff-b42b-daa565666d79 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 204 len: 0 microversion: 2.1 time: 0.347863 Jun 23 09:38:51.610377 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 587/1159] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:38:51 2022] DELETE /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 09:38:51.622435 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:51.623189 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:51.629584 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:51.630037 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:51.630809 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:51.631285 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:51.762830 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.policy [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118501) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:51.771093 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-b1f50079-a086-442e-83e2-2c93e6bef73c tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1577 microversion: 2.1 time: 0.153529 Jun 23 09:38:51.771656 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 573/1160] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:51 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 09:38:52.789005 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:52.789828 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:52.796314 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:52.796780 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:52.797511 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:52.797941 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:52.989851 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:52.997948 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-fc71974a-d376-4a47-858c-bd736f8402dc tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1577 microversion: 2.1 time: 0.213654 Jun 23 09:38:52.998468 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 588/1161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:52 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:38:53.696202 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [req-23c27a49-d979-4138-8939-174b70236d90 req-3d3fd017-7dfe-404b-be61-221affa293d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04b8db5-ba9f-4327-b57c-51c3462e3efa", "name": "network-vif-deleted", "tag": "f892b7da-7cfb-4af4-98f8-866d8071f8b1"}]} {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 09:38:53.704856 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-23c27a49-d979-4138-8939-174b70236d90 req-3d3fd017-7dfe-404b-be61-221affa293d6 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:53.705306 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [req-23c27a49-d979-4138-8939-174b70236d90 req-3d3fd017-7dfe-404b-be61-221affa293d6 service nova] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:53.716647 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.compute.server_external_events [req-23c27a49-d979-4138-8939-174b70236d90 req-3d3fd017-7dfe-404b-be61-221affa293d6 service nova] Creating event network-vif-deleted:f892b7da-7cfb-4af4-98f8-866d8071f8b1 for instance e04b8db5-ba9f-4327-b57c-51c3462e3efa on hv-cinder-84727 Jun 23 09:38:53.721366 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [req-23c27a49-d979-4138-8939-174b70236d90 req-3d3fd017-7dfe-404b-be61-221affa293d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028853 Jun 23 09:38:53.721930 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 574/1162] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jun 23 09:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 09:38:54.015770 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:54.016392 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:54.023677 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:54.024235 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:54.026831 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:54.027361 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:54.095782 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.policy [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a640cdceb34bb9bfbb7b769e797d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100fa3c9d124f9089173a35a1e3691d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118500) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 09:38:54.104024 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-3b4c9b49-6eac-4746-bf78-9e0fc47c14d7 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 200 len: 1225 microversion: 2.1 time: 0.092128 Jun 23 09:38:54.104597 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 589/1163] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:54 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 09:38:55.122107 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:55.122804 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: e04b8db5-ba9f-4327-b57c-51c3462e3efa] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:55.129056 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:55.129505 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:55.130261 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:55.130695 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:55.143538 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] HTTP exception thrown: Instance e04b8db5-ba9f-4327-b57c-51c3462e3efa could not be found. Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Request method failure captured: Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa HTTP/1.1 Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDLxf_6kvri3WWl0fJag_poW8xoWH7fV-r2-QzgfuXZxAe6sZzBmk_JUnUox-QdjyTCxUBrrPNPj4oUCRoJWCMLfRN_9kmGRuyUHlJAWvAdJeVtzuecBjiiqum5N32lI-sKuQgsyMLYz1TzSQY6EIecDcs6Vvr9FJvF4yXBs-VvzAcA Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:38:55.145643 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a100fa3c9d124f9089173a35a1e3691d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 86a640cdceb34bb9bfbb7b769e797d30 Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance e04b8db5-ba9f-4327-b57c-51c3462e3efa could not be found. Jun 23 09:38:55.149911 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': 'e04b8db5-ba9f-4327-b57c-51c3462e3efa'} Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04b8db5-ba9f-4327-b57c-51c3462e3efa could not be found. Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:38:55.151145 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04b8db5-ba9f-4327-b57c-51c3462e3efa could not be found. Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04b8db5-ba9f-4327-b57c-51c3462e3efa could not be found. Jun 23 09:38:55.153473 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.155126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Returning 404 to user: Instance e04b8db5-ba9f-4327-b57c-51c3462e3efa could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:38:55.155126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-4cb400bb-c8e5-4bc2-9352-f758afe1f901 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa" status: 404 len: 111 microversion: 2.1 time: 0.029897 Jun 23 09:38:55.155126 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 575/1164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:55 2022] GET /compute/v2.1/servers/e04b8db5-ba9f-4327-b57c-51c3462e3efa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:38:55.669145 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:55.669668 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.compute.api [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118500) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:55.676178 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:55.676629 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:55.677389 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:55.677820 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG oslo_concurrency.lockutils [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:55.690853 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.wsgi [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] HTTP exception thrown: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Request method failure captured: Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: request: DELETE /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 HTTP/1.1 Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept: application/json Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Accept-Encoding: identity Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Connection: close Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Length: 0 Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Content-Type: application/json Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Host: 10.222.0.52 Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Openstack-System-Scope: None Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: User-Agent: python-urllib3/1.26.9 Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Auth-Token: gAAAAABitDLxf_6kvri3WWl0fJag_poW8xoWH7fV-r2-QzgfuXZxAe6sZzBmk_JUnUox-QdjyTCxUBrrPNPj4oUCRoJWCMLfRN_9kmGRuyUHlJAWvAdJeVtzuecBjiiqum5N32lI-sKuQgsyMLYz1TzSQY6EIecDcs6Vvr9FJvF4yXBs-VvzAcA Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Id: None Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Domain-Name: None Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Identity-Status: Confirmed Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Is-Admin-Project: True Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Id: default Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Domain-Name: Default Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Project-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Role: member,reader Jun 23 09:38:55.693031 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Roles: member,reader Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a100fa3c9d124f9089173a35a1e3691d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Id: default Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Domain-Name: Default Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Id: 86a640cdceb34bb9bfbb7b769e797d30 Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: X-User-Name: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: method: > Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: exception: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.694834 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: action_args: {'id': '97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147'} Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:38:55.695883 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.697356 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.698822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Returning 404 to user: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. {{(pid=118500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:38:55.698822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-17a357ee-0b69-405a-b4d1-e124bf370363 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 404 len: 111 microversion: 2.1 time: 0.029256 Jun 23 09:38:55.698822 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 590/1165] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jun 23 09:38:55 2022] DELETE /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:38:55.702886 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '>' {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:55.703522 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.compute.api [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] [instance: 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147] Fetching instance by UUID {{(pid=118501) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 09:38:55.710094 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:55.710573 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:55.711369 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 09:38:55.711808 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG oslo_concurrency.lockutils [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Lock "ad430a24-c3fd-4ac3-a88b-78701c74d764" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 09:38:55.724858 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.wsgi [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] HTTP exception thrown: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Request method failure captured: Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: request: GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 HTTP/1.1 Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept: application/json Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Accept-Encoding: identity Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Connection: close Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Length: 0 Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Content-Type: application/json Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Host: 10.222.0.52 Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Openstack-System-Scope: None Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: User-Agent: python-urllib3/1.26.9 Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Auth-Token: gAAAAABitDLxf_6kvri3WWl0fJag_poW8xoWH7fV-r2-QzgfuXZxAe6sZzBmk_JUnUox-QdjyTCxUBrrPNPj4oUCRoJWCMLfRN_9kmGRuyUHlJAWvAdJeVtzuecBjiiqum5N32lI-sKuQgsyMLYz1TzSQY6EIecDcs6Vvr9FJvF4yXBs-VvzAcA Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Id: None Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Domain-Name: None Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Identity-Status: Confirmed Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Is-Admin-Project: True Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Id: default Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Domain-Name: Default Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Project-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Role: member,reader Jun 23 09:38:55.726338 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Roles: member,reader Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a100fa3c9d124f9089173a35a1e3691d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a100fa3c9d124f9089173a35a1e3691d", "adminURL": "http://10.222.0.52:8080"}]}] Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Id: a100fa3c9d124f9089173a35a1e3691d Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122760550 Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Id: default Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Domain-Name: Default Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Id: 86a640cdceb34bb9bfbb7b769e797d30 Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: X-User-Name: tempest-TestVolumeBootPattern-2122760550-project Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: method: > Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: exception: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.728161 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: action_args: {'id': '97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147'} Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: {{(pid=118501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 09:38:55.729179 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. Jun 23 09:38:55.730865 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: ERROR nova.api.openstack.wsgi Jun 23 09:38:55.732476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: DEBUG nova.api.openstack.wsgi [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Returning 404 to user: Instance 97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 could not be found. {{(pid=118501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 09:38:55.732476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO nova.api.openstack.requestlog [None req-1e53ebbe-7b0e-46f3-9526-d5be2a6229bb tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147" status: 404 len: 111 microversion: 2.1 time: 0.028629 Jun 23 09:38:55.732476 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: [pid: 118501|app: 0|req: 576/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jun 23 09:38:55 2022] GET /compute/v2.1/servers/97d7c4e8-2a4e-4db9-bbbf-ce36b52ad147 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 09:38:57.230779 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: DEBUG nova.api.openstack.wsgi [None req-ea8f9945-dbf7-42c2-ac0c-a22e1ba88cd4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] Calling method '.version_select at 0x7f827139cf70>' {{(pid=118500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 09:38:57.333849 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO nova.api.openstack.requestlog [None req-ea8f9945-dbf7-42c2-ac0c-a22e1ba88cd4 tempest-TestVolumeBootPattern-2122760550 tempest-TestVolumeBootPattern-2122760550-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1906002326" status: 202 len: 0 microversion: 2.1 time: 0.106834 Jun 23 09:38:57.334433 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: [pid: 118500|app: 0|req: 591/1167] 10.222.0.52 () {58 vars in 1262 bytes} [Thu Jun 23 09:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1906002326 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 09:39:01.991727 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:39:01.992296 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Thu Jun 23 09:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:41:04.137693 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 23 09:41:04.138226 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Thu Jun 23 09:41:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:41:36.663101 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:41:36.663892 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Thu Jun 23 09:41:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:41:37.472380 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:41:37.472960 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Thu Jun 23 09:41:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:41:52.206735 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:41:52.207271 dv-cinder-847274-1-iscsi devstack@n-api.service[118500]: Thu Jun 23 09:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:42:12.633427 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:42:12.634027 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Thu Jun 23 09:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 09:44:02.002345 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 09:44:02.003209 dv-cinder-847274-1-iscsi devstack@n-api.service[118501]: Thu Jun 23 09:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!